Cover not available

Article published In: Gesture
Vol. 15:3 (2016) ► pp.291–305

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
authorization required

Embodiment and American Sign Language

Exploring sensory-motor influences in the recognition of American Sign Language

 | Center for Mind and Brain, University of California, Davis
 | Departamento de Metodología de las Ciencias del Comportamiento, Universitat de València
Published online: 6 December 2016
DOI logo with link
https://doi.org/10.1075/gest.15.3.01cor
Little is known about how individual signs that occur in naturally produced signed languages are recognized. Here we examine whether sign understanding may be grounded in sensorimotor properties by evaluating a signer’s ability to make lexical decisions to American Sign Language (ASL) signs that are articulated either congruent with or incongruent with the observer’s own handedness. Our results show little evidence for handedness congruency effects for native signers’ perception of ASL, however handedness congruency effects were seen in non-native late learners of ASL and hearing ASL-English bilinguals. The data are compatible with a theory of sign recognition that makes reference to internally simulated articulatory control signals — a forward model based upon sensory-motor properties of one’s owns body. The data suggest that sign recognition may rely upon an internal body schema when processing is non-optimal as a result of having learned ASL later in life. Native signers however may have developed representations of signs which are less bound to the hand with which it is performed, suggesting a different engagement of an internal forward model for rapid lexical decisions.
References (30)
Adank, Patti, Shirley-Ann Rueschemeyer, & Harold Bekkering (2013). The role of accent imitation in sensorimotor integration during processing of intelligible speech. Frontiers in Human Neuroscience, 7, Article 634. Google Scholar logo with link to Google Scholar
Balota, David A. & James I. Chumbley (1984). Are lexical decisions a good measure of lexical access? The role of word frequency in the neglected decision stage. Journal of Experimental Psychology: Human Perception and Performance, 10 (3), 340–357. Google Scholar logo with link to Google Scholar
Callan, Akiko M., Daniel E. Callan, Keiichi Tajima, & Reiko Akahane-Yamada (2006). Neural processes involved with perception of non-native durational contrasts. Neuroreport, 17 (12), 1353–1357. Google Scholar logo with link to Google Scholar
Callan, Daniel E., Jeffery A. Jones, Akiko M. Callan, & Reiko Akahane-Yamada (2004). Phonetic perceptual identification by native- and second-language speakers differentially activates brain regions involved with acoustic phonetic processing and those involved with articulatory-auditory/orosensory internal models. Neuroimage, 22 (3), 1182–1194. Google Scholar logo with link to Google Scholar
Callan, Daniel, Akiko Callan, & Jeffery A. Jones (2014). Speech motor brain regions are differentially recruited during perception of native and foreign-accented phonemes for first and second language listeners. Frontiers in Neuroscience, 81, 1–15. Google Scholar logo with link to Google Scholar
Corina, David & Heather Knapp (2006). Sign language processing and the mirror neuron system. Cortex, 42 (4), 529–539. Google Scholar logo with link to Google Scholar
Du, Yi, Bradley R. Buchsbaum, Cheryl L. Grady, & Claude Alain (2014). Noise differentially impacts phoneme representations in the auditory and speech motor systems. Proceedings of the National Academy of Sciences, 111 (19), 7126–7131. .Google Scholar logo with link to Google Scholar
Emmorey, Karen (2002). Language, cognition, and the brain: Insights from sign language research. Mahwah, NJ: Lawrence Erlbaum.Google Scholar logo with link to Google Scholar
Emmorey, Karen, Jennifer A. Petrich, & Tamar H. Gollan (2012). Bilingual processing of ASL–English code-blends: The consequences of accessing two lexical representations simultaneously. Journal of Memory and Language, 67 (1), 199–210. Google Scholar logo with link to Google Scholar
Galantucci, Bruno, Carol A. Fowler, & Michael T. Turvey (2006). The motor theory of speech perception reviewed. Psychonomic Bulletin & Review, 13 (3), 361–377. Google Scholar logo with link to Google Scholar
Hickok, Greg (2010). The role of mirror neurons in speech perception and action word semantics. Language and Cognitive Processes, 25 (6), 749–776. Google Scholar logo with link to Google Scholar
Iacoboni, Marco (2008). The role of premotor cortex in speech perception: Evidence from fMRI and rTMS. Journal of Physiology – Paris, 102 (1), 31–34. Google Scholar logo with link to Google Scholar
Liberman, Alvin M., Franklin S. Cooper, Donald P. Shankweiler, & Michael Studdert-Kennedy (1967). Perception of the speech code. Psychological Review, 74 (6), 431–461. Google Scholar logo with link to Google Scholar
Liberman, Alvin M. & Ignatius G. Mattingly (1985). The motor theory of speech perception revised. Cognition, 21 (1), 1–36. Google Scholar logo with link to Google Scholar
MacSweeney, Mairéad, Bencie Woll, Ruth Campbell, Philip K. McGuire, Anthony S. David, Steven C.R. Williams, John Suckling, Gemma A. Calvert, & Michael J. Brammer (2002). Neural systems underlying British Sign Language and audio‐visual English processing in native users. Brain, 125 (7), 1583–1593. Google Scholar logo with link to Google Scholar
Miall, R. Chris (2003). Connecting mirror neurons and forward models. Neurorepor, 14 (17), 2135–2137. Google Scholar logo with link to Google Scholar
Neville, Helen J., Daphne Bavelier, David Corina, Josef Rauschecker, Avi Karni, Anil Lalwani, Allen Braun, Vince Clark, Peter Jezzard, & Robert Turner (1998). Cerebral organization for language in deaf and hearing subjects: Biological constraints and effects of experience. Proceedings of the National Academy of Sciences, 95 (3), 922–929. Google Scholar logo with link to Google Scholar
Poeppel, David, William J. Idsardi, & Virginie van Wassenhove (2008). Speech perception at the interface of neurobiology and linguistics. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 363 (1493), 1071–1086. Google Scholar logo with link to Google Scholar
Pulvermüller, Friedemann, Martina Huss, Ferath Kherif, Fermin Moscoso del Prado Martin, Olaf Hauk, & Yury Shtyrov (2006). Motor cortex maps articulatory features of speech sounds. Proceedings of the National Academy of Sciences of the United States of America, 103 (20), 7865–7870. Google Scholar logo with link to Google Scholar
Rauschecker, Josef P. (2011). An expanded role for the dorsal auditory pathway in sensorimotor control and integration. Hearing Research, 271 (1), 16–25. Google Scholar logo with link to Google Scholar
Schwartz, Jean-Luc, Anahita Basirat, Lucie Ménard, & Marc Sato (2012). The Perception-for-Action-Control Theory (PACT): A perceptuo-motor theory of speech perception. Journal of Neurolinguistics, 25 (5), 336–354. Google Scholar logo with link to Google Scholar
Skipper, Jeremy I., Susan Goldin-Meadow, Howard Nusbaum, & Steven Small (2007). Speech associated gestures, Broca’s area and the human mirror system. Brain and Language, 101 (3), 260–277. Google Scholar logo with link to Google Scholar
Thompson, Robin & Gabriella Vigliocco (2013). The relationship between sign production and sign comprehension: What the hands reveal. Presentation at the Conference Theoretical Issues in Sign Language Research , 2013.
Tremblay, Pascale & Steven L. Small (2011). On the context-dependent nature of the contribution of the ventral premotor cortex to speech perception. NeuroImage, 57 (4), 1561–1571. Google Scholar logo with link to Google Scholar
Wang, Yue, Joan A. Sereno, Allard Jongman, & Joy Hirsch (2003). fMRI evidence for cortical modification during learning of mandarin lexical tone. Journal of Cognitive Neuroscience, 15 (7), 1019–1027. Google Scholar logo with link to Google Scholar
Willems, Roel M. & Peter Hagoort (2007). Neural evidence for the interplay between language, gesture, and action: A review. Brain and Language, 101 (3), 278–289. Google Scholar logo with link to Google Scholar
Willems, Roel M., Peter Hagoort, & Daniel Casasanto (2010). Body-specific representations of action verbs: Neural evidence from right-and left-handers. Psychological Science, 21 (1), 67–74. Google Scholar logo with link to Google Scholar
Wilson, Stephen M., Ayse P. Saygin, Martin I. Sereno, & Marco Iacoboni (2004). Listening to speech activates motor areas involved in speech production. Nature Neuroscience, 7 (7), 701–702. Google Scholar logo with link to Google Scholar
Wilson, Stephen M. & Marco Iacoboni (2006). Neural responses to non-native phonemes varying in producibility: Evidence for the sensorimotor nature of speech perception. NeuroImage, 33 (1), 316–325. Google Scholar logo with link to Google Scholar
Wolpert, Daniel, Kenji Doya, & Mitsuo Kawato (2003). A unifying computational framework for motor control and social interaction. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 358 (1431), 593–602. Google Scholar logo with link to Google Scholar
Cited by (8)

Cited by eight other publications

Morett, Laura M., Mathew Cieśla, Mary E. Bray & Karen Emmorey
2024. Feeling signs: Motor encoding enhances sign language learning in hearing adults. Studies in Second Language Acquisition 46:3 ► pp. 933 ff. DOI logo
Watkins, Freya, Diar Abdlkarim, Bodo Winter & Robin L. Thompson
2024. Viewing angle matters in British Sign Language processing. Scientific Reports 14:1 DOI logo
Sehyr, Zed Sevcikova, Katherine J. Midgley, Karen Emmorey & Phillip J. Holcomb
2023. Asymetric Event-Related Potential Priming Effects Between English Letters and American Sign Language Fingerspelling Fonts. Neurobiology of Language 4:2 ► pp. 361 ff. DOI logo
Clarke, Jean S., Nicholas Llewellyn, Joep Cornelissen & Rowena Viney
2021. Gesture Analysis and Organizational Research: The Development and Application of a Protocol for Naturalistic Settings. Organizational Research Methods 24:1 ► pp. 140 ff. DOI logo
Bogliotti, Caroline, Hatice Aksen, Frédéric Isel & Bencie Woll
2020. Language experience in LSF development: Behavioral evidence from a sentence repetition task. PLOS ONE 15:11 ► pp. e0236729 ff. DOI logo
Brozdowski, Chris & Karen Emmorey
2020. Shadowing in the manual modality. Acta Psychologica 208 ► pp. 103092 ff. DOI logo
Gawne, Lauren, Chelsea Krajcik, Helene N. Andreassen, Andrea L. Berez-Kroeker & Barbara F. Kelly
2019. Data transparency and citation in the journal Gesture . Gesture 18:1 ► pp. 83 ff. DOI logo
Quandt, Lorna C. & Emily Kubicek
2018. Sensorimotor characteristics of sign translations modulate EEG when deaf signers read English. Brain and Language 187 ► pp. 9 ff. DOI logo

This list is based on CrossRef data as of 9 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue