Article published In: Signed and spoken language contrastive research: A multimodal approach
Edited by Sílvia Gabarró-López and Laurence Meurant
[Languages in Contrast 22:2] 2022
► pp. 227–258
Embodied cognition
ASL signers’ and English speakers’ use of viewpointed space
Available under the Creative Commons Attribution-NonCommercial (CC BY-NC) 4.0 license.
For any use beyond this license, please contact the publisher at rights@benjamins.nl.
This article was made Open Access under a CC BY-NC 4.0 license through payment of an APC by or on behalf of the author.
Published online: 4 July 2022
https://doi.org/10.1075/lic.00020.jan
https://doi.org/10.1075/lic.00020.jan
Abstract
Recent work has shown that ASL (American Sign Language) signers not only articulate the language in the space in
front of and around them, they interact with that space bodily, such that those interactions are frequently viewpointed. At a
basic level, signers use their bodies to depict the actions of characters, either themselves or others, in narrative retelling.
These viewpointed instances seem to reflect “embodied cognition”, in that our construal of reality is largely due to the nature of
our bodies (Evans, V. and Green, M. 2006. Cognitive
Linguistics: An Introduction. Edinburgh: Edinburgh University Press.) and “embodied language” such that the symbols we use
to communicate are “grounded in recurring patterns of bodily experience” (Gibbs, R. W. Jr. 2017. Embodiment. In Cambridge
Handbook of Cognitive Linguistics, B. Dancygier (ed.), 449–462. Cambridge: Cambridge University Press. : 450). But what about speakers of a spoken language such as English? While we know that meaning and structure for any
language, whether spoken or signed, affect and are affected by the embodied mind (note that the bulk of research on embodied
language has been about spoken, not signed, language), we can learn much about embodied cognition and viewpointed space when
spoken languages are treated as multimodal. Here, we compare signed ASL and spoken, multimodal English discourse to examine
whether the two languages incorporate viewpointed space in similar or different ways.
Keywords: multimodality, viewpoint, perspective-taking, stance, English/ASL
Article outline
- 1.Introduction
- 2.Embodied cognition and embodied language
- 2.1Gesturing and signing as embodied language
- 3.Viewpoint and stance
- 4.The narrative data
- 4.1The ASL narratives
- 4.2The multimodal English narratives
- 5.Perspectivized spaces
- 5.1Positioning referents in a space
- 5.2Interacting with referents spatially
- 5.2.1Portraying the perspective of a third person referent
- 6.Stance-taking and stance-stacking
- 7.Dual viewpointing
- 8.Conclusion
- ASL transcription key
- Notes
References
References (62)
Altman, M. 2009. Understanding
Embodiment: Psychophysiological Models in Traditional Medical
Systems. In New Directions in Cognitive
Linguistics, V. Evans and S. Pourcel (eds), 311–329. Amsterdam: John Benjamins.
Bucholtz, M. and Hall, K. 2016. Embodied
Sociolinguistics. In Sociolinguistics: Theoretical
Debates, N. Coupland (ed.), 173–197. Cambridge: Cambridge University Press.
Bybee, J., Perkins, R. and Pagliuca, W. 1994. The
Evolution of Grammar: Tense, Aspect, and Modality in the Languages of the
World. Chicago: University of Chicago Press.
Croft, W. 2000. Explaining
Language Change: An Evolutionary
Approach. Harlow: Longman Linguistics Library, Pearson Education Ltd.
Dancygier, B. 2012a. Negation,
Stance Verbs, and Intersubjectivity. In Viewpoint in Language: A
Multimodal Perspective, B. Dancygier and E. Sweetser (eds), 69–93. Cambridge: Cambridge University Press.
2012b. Conclusion:
Multiple Viewpoints, Multiple Spaces. In Viewpoint in Language: A
Multimodal Perspective, B. Dancygier and E. Sweetser (eds), 219–231. Cambridge: Cambridge University Press.
Dancygier, B., Rice, S. and Janzen, T. 2019. Stance-Stacking
in Language and Multimodal Communication. Paper presented at
the Fifteenth International Cognitive Linguistics Conference (ICLC
15), Nishinomiya, Japan, 6–10 August
2019.
Du Bois, J. W. 2007. The
Stance Triangle. In Stancetaking in Discourse: Subjectivity,
Evaluation, Interaction, R. Englebretson (ed.), 139–182. Amsterdam: John Benjamins.
Earis, H. and Cormier, K. 2013. Point
of View in British Sign Language and Spoken English Narrative Discourse: The Example of “The Tortoise and the
Hare”. Language and
Cognition 5(4): 313–343.
Enfield, N. J. 2009. The
Anatomy of Meaning: Speech, Gesture, and Composite
Utterances. Cambridge: Cambridge University Press.
2013. A
‘Composite Utterances’ Approach to Meaning. In Body – Language –
Communication: An International Handbook on Multimodality in Human Interaction. Volume 1. (Handbooks of Linguistics and
Communication Science 38.1.), C. Müller, A. Cienki, E. Fricke, S. Ladewig, D. McNeill and S. Tessendorf (eds), 689–707. Berlin: Mouton de Gruyter.
Engberg-Pedersen, E. 1993. Space
in Danish Sign Language: The Semantics and Morphosyntax of the Use of Space in a Visual
Language. Hamburg: Signum.
Evans, V. and Green, M. 2006. Cognitive
Linguistics: An Introduction. Edinburgh: Edinburgh University Press.
Ferrara, L. and Hodge, G. 2018. Language
as Description, Indication, and Depiction. Frontiers in
Psychology 9(716): 1–15.
Ferrara, L. and Johnston, T. 2014. Elaborating
who’s what: A Study of Constructed Action and Clause Structure in Auslan (Australian Sign
Language). Australian Journal of
Linguistics 34(2): 193–215.
Ferrari, L. and Sweetser, E. 2012. Subjectivity
and Upwards Projection in Mental Space Structure. In Viewpoint in
Language: A Multimodal Perspective, B. Dancygier and E. Sweetser (eds), 47–68. Cambridge: Cambridge University Press.
Gärdenfors, P. 2004. Conceptual
Spaces as a Framework for Knowledge Representation. Mind and
Matter 2(2): 9–27.
Gibbs, R. W. Jr. 2017. Embodiment. In Cambridge
Handbook of Cognitive Linguistics, B. Dancygier (ed.), 449–462. Cambridge: Cambridge University Press.
Hanks, W. F. 1990. Referential
Practice: Language and Lived Space Among the
Mayan. Chicago: University of Chicago Press.
Haviland, J. B. 2000. Pointing,
Gesture Spaces, and Mental Maps. In Language and
Gesture, D. McNeill (ed.), 13–46. Cambridge: Cambridge University Press.
Hostetter, A. B. and Alibali, M. B. 2008. Visible
Embodiment: Gestures as Simulated Action. Psychonomic Bulletin &
Review 15(3): 495–514.
Janzen, T. 2004. Space
Rotation, Perspective Shift, and Verb Morphology in ASL. Cognitive
Linguistics 15(2): 149–174.
2006. Visual
Communication: Signed Language and Cognition. In Cognitive
Linguistics: Current Applications and Future Perspectives, G. Kristiansen, M. Achard, R. Dirven and F. J. Ruiz de Mendoza Ibáñez (eds), 359–377. Berlin: Mouton de Gruyter.
2012. Two
Ways of Conceptualizing Space: Motivating the Use of Static and Rotated Vantage Point Space in ASL
Discourse. In Viewpoint in Language: A Multimodal
Perspective, B. Dancygier and E. Sweetser (eds), 156–174. Cambridge: Cambridge University Press.
2017. Composite
Utterances in a Signed Language: Topic Constructions and Perspective-Taking in ASL. Cognitive
Linguistics 28(3): 511–538.
2019. Shared
Spaces, Shared Mind: Connecting Past and Present Viewpoints in American Sign Language
Narratives. Cognitive
Linguistics 30(2): 253–279.
Janzen, T., Shaffer, B. and Leeson, L. 2017. Does
Grammar Include Gesture? Evidence from Two Signed Languages. Paper presented at
the Fourteenth International Cognitive Linguistics Conference (ICLC
14), Tartu, Estonia, 10–14 July
2017.
2019. The
Embodiment of Stance in Narratives in Two Signed Languages. Paper presented at
the Fifteenth International Cognitive Linguistics Conference (ICLC
15), Nishinomiya, Japan, 6–10 August
2019.
forthcoming. What
I Know Is Here; what I don’t Know Is Somewhere Else: Deixis and Gesture Spaces in American Sign Language and Irish Sign
Language. In Signed Language and Gesture Research in Cognitive
Linguistics, T. Janzen and B. Shaffer (eds). Berlin: de Gruyter Mouton.
Johnson, M. 1987. The
Body in the Mind: The Bodily Basis of Meaning, Imagination, and
Reason. Chicago: University of Chicago Press.
2014. Semiotic
Diversity in Utterance Production and the Concept of ‘Language’. Philosophical Transactions of
The Royal Society
B 3691: 20130293. 1–13.
Lakoff, G. and Johnson, M. 1999. Philosophy
in the Flesh: The Embodied Mind and its Challenge to Western Thought. New York: Basic Books.
Liddell, S. K. 2003. Grammar,
Gesture, and Meaning in American Sign
Language. Cambridge: Cambridge University Press.
MacWhinney, B. 2013. The
Emergence of Language from Embodiment. In The Emergence of
Language, B. MacWhinney (ed.), 213–256. Mahwah: Lawrence Erlbaum.
McNeill, D. 1992. Hand
and Mind: What Gestures Reveal about
Thought. Chicago: University of Chicago Press.
Müller, C. 2018. Gesture
and Sign: Cataclysmic Break or Dynamic Relations? Frontiers in
Psychology 9(1651): 1–20.
Ohala, J. J. 1994. The
Frequency Code Underlies the Sound-Symbolic Use of Voice
Pitch. In Sound Symbolism, L. Hinton, J. Nichols and J. J. Ohala (eds), 325–347. Cambridge: Cambridge University Press.
Parrill, F. 2009. Dual
Viewpoint
Gestures. Gesture 9(3): 271–289.
2012. Interactions
between Discourse Status and Viewpoint in Co-Speech
Gesture. In Cambridge Handbook of Cognitive
Linguistics, B. Dancygier (ed.), 97–112. Cambridge: Cambridge University Press.
Podesva, R. J. 2013. Gender
and the Social Meaning of Non-Modal Phonation Types. Proceedings of the Annual Meeting of the
Berkeley Linguistics Society (Vol. 371), C. Cathcart, I-H. Chen, G. Finley, S. Kang, C. S. Sandy and E. Stickles (eds), 427–448. Available
at [URL]
Quinto-Pozos, D. and Parrill, F. 2015. Signers
and Co-Speech Gesturers Adopt Similar Strategies for Portraying Viewpoint in Narratives. Topics
in Cognitive Science 71: 12–35.
Sams, J. 2010. Quoting
the Unspoken: An Analysis of Quotations in Spoken Discourse. Journal of
Pragmatics 421: 3147–3160.
Scheibman, J. 2002. Point
of View and Grammar: Structural Patterns of Subjectivity in American
Conversation. Amsterdam: John Benjamins.
Sweetser, E. 2012. Introduction:
Viewpoint and Perspective in Language and Gesture, from the Ground
down. In Viewpoint in Language: A Multimodal
Perspective, B. Dancygier and E. Sweetser (eds), 1–22. Cambridge: Cambridge University Press.
2013. Creativity
across Modalities in Viewpoint Construction. In Language and the
Creative Mind, M. Borkent, B. Dancygier and J. Hinnell (eds), 239–254. Stanford: CSLI Publications.
Sweetser, E. and Stec, K. 2016. Maintaining
Multiple Viewpoints with Gaze. In Viewpoint and the Fabric of
Meaning: Form and Use of Viewpoint Tools Across Languages and Modalities, B. Dancygier, V.-l. Lu and A. Verhagen (eds), 237–257. Berlin: de Gruyter Mouton.
Traugott, E. C. and Dasher, R. B. 2002. Regularity
in Semantic Change. Cambridge: Cambridge University Press.
Vandelanotte, L. 2017. Viewpoint. In Cambridge
Handbook of Cognitive Linguistics, B. Dancygier (ed.), 157–171. Cambridge: Cambridge University Press.
Verhagen, A. 2005. Constructions
of Intersubjectivity: Discourse, Syntax, and
Cognition. Oxford: Oxford University Press.
2004. A
Cognitive Key: Metonymic and Metaphorical Mappings in ASL. Cognitive
Linguistics 15(2): 197–222.
Wilcox, S. E. 2002. The
Gesture-Language Interface: Evidence from Signed
Languages. In Progress in Sign Language Research: In Honor of
Siegmund Prillwitz/Fortschritte in der Gebärdensprachforschung: Festschrift für Siegmund
Prillwitz, R. Schulmeister and H. Reinitzer (eds), 63–81. Hamburg: Signum-Verlag.
2004. Gesture
and Language: Cross-Linguistic and Historical Data from Signed
Languages. Gesture 4(1): 43–73.
Cited by (9)
Cited by nine other publications
Janzen, Terry
Kwon, Iksoo
Mellett, Erin
Andries, Fien
de Vries, Clarissa, Fien Andries & Katharina Meissl
Shamay-Tsoory, Simone G & Alisa Kanterman
Andries, Fien, Geert Brône & Myriam Vermeerbergen
Meissl, Katharina, Paul Sambre & Kurt Feyaerts
Vandenitte, Sébastien
This list is based on CrossRef data as of 25 november 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.
