Article published In: Sign Language & Linguistics: Online-First Articles
Action depiction in gestures and signs
A comparative semiotic approach
Published online: 11 November 2025
https://doi.org/10.1075/sll.24003.bon
https://doi.org/10.1075/sll.24003.bon
Abstract
The relation between gestures and signs is highly debated both in gestures and sign language studies. Addressing
the common symbolic ground from which both gestures and signs arise could improve our general knowledge about the body’s role in
meaning construction and in shaping communication. To effectively compare how signers and speakers employ their bodies to convey
meanings, we investigated how actions are depicted in gestures and signs by collecting and comparing data from 15 hearing Italian
speakers and 10 Deaf LIS signers. Specifically, the present study addresses the use of representational strategies (i.e., own
body, hand-as-hand, hand-as-object) in co-speech gestures and signs in different action domains (i.e., to break, to take, to
attach, to open, to turn). We aim to look at how different action domains affect the distribution of representational strategies
in gestures and signs. Our results showed that action domains influenced the use of representational strategies similarly among
signers and speakers, suggesting that action events are conceptualized alike. Nevertheless, there are qualitative differences in
action depiction, discussed throughout the paper, as well as in the combination of different representational strategies, used
less by Italian speakers, compared to LIS signers.
Keywords: action verbs, LIS, gestures, comparative semiotics, iconicity, depicting constructions
Article outline
- 1.Introduction
- 2.Materials and procedure
- 3.Participants
- 4.Analysis
- 5.Coding
- 6.Results
- 7.Discussion
- 8.Conclusions
References
References (53)
Armstrong, David F. 1999. Original signs: Gesture, sign, and the
sources of language. Washington D.C.: Gallaudet University Press.
Armstrong, David F., William C. Stokoe & Sherman Wilcox. 1995. Gesture
and the nature of language. Cambridge: Cambridge University Press.
Bonsignori, Chiara. 2024. Describing
actions: the semantic role of gestures. Rivista di psicolinguistica applicata/Journal of
Applied Psycholinguistics, XXIV edition.
. 2025. Tra
segnato e parlato: appunti per una semiotica comparativa (Collana Linguistica e Linguistiche
13). Quarto Inferiore, Bologna: Pàtron editore.
Brentari, Diane, Alessio Di Renzo, Jonathan Keane & Virginia Volterra. 2015. Cognitive,
cultural, and linguistic sources of a handshape distinction expressing agentivity. Topics in
Cognitive
Science 7(1). 95–123.
Cacioli, Caterina & Paola Vernillo. 2023. How
did you break that? Semantic boundaries of Italian and English action verbs encoding breaking
events. Languages in
Contrast 23(1). 93–120.
Capirci, Olga, Chiara Bonsignori & Alessio Di Renzo. 2022. Signed
languages: A triangular semiotic dimension. Frontiers in
Psychology 121.
Capirci, Olga, Annarita Contaldo, Maria Cristina Caselli & Virginia Volterra. 2005. From
action to language through gesture: A longitudinal
perspective. Gesture 5(1–2). 155–177.
Capirci, Olga, Morgana Proietti & Virginia Volterra. 2022. Searching
for the roots of signs in children’s early
gestures. Gesture 21(2–3). 201–238.
Caselli, Maria Cristina, Simonetta Maragna, Laura Rampelli Pagliari & Virginia Volterra. 1994. Linguaggio
e sordità: parole e segni per l’educazione dei
sordi. Firenze: La Nuova Italia.
Chu, Mingyuan, Antje Meyer, Lucy Foulkes & Sotaro Kita. 2014. Individual
differences in frequency and saliency of speech-accompanying gestures: The role of cognitive abilities and
empathy. Journal of Experimental Psychology:
General 143(2). 694–709.
Cohen, Jacob. 1960. A
coefficient of agreement for nominal scales. Educational and psychological
measurement 20(1). 37–46.
Cominetti, Federica & Alessandro Panunzi. 2020. Just
a matter of manner? Modeling action verb semantics in an inter-linguistic perspective. Testi e
linguaggi 141. 217–241.
Cuxac, Christian & Marie-Anne Sallandre. 2007. Iconicity
and arbitrariness in French Sign Language: Highly iconic structures, degenerated iconicity and diagrammatic
iconicity. In Elena Pizzuto, Paola Pietrandrea & Raffaele Simone (eds.), Verbal
and signed languages: Comparing structures, constructs and
methodologies, 13–34. Berlin: De Gruyter Mouton.
Gao, Helena Hong. 2001. The physical foundation of the
patterning of physical action verbs: A study of Chinese verbs (Travaux de l’Institut de Linguistique
de
Lund). Vol. 411. Lund: Lund University.
Goldin-Meadow, Susan & Diane Brentari. 2017. Gesture,
sign, and language: The coming of age of sign language and gesture studies. Behavioral and
Brain Sciences 401. 1–17.
Hostetter, Autumn B. & Martha W. Alibali. 2008. Visible
embodiment: Gestures as simulated action. Psychonomic Bulletin and
Review 15(3). 495–514.
. 2019. Gesture
as simulated action: Revisiting the framework. Psychonomic Bulletin and
Review 26(3). 721–752.
Kendon, Adam. 2002. Historical
Observations on the Relationship Between Research on Sign Languages and Language Origins
Theory. In David Armstrong, Michel A. Karchmar & John Vickerey Va Cleve (eds.), The
Study of Signed Languages: Essays in Honor of William C.
Stokoe, 35–52. Washington, D.C: Gallaudet University Press.
. 2008. Some
reflections on the relationship between ‘gesture’ and
‘sign’. Gesture 8(3). 348–366.
. 2014. Semiotic
diversity in utterance production and the concept of ‘language’. Philosophical Transactions of
the Royal Society B: Biological
Sciences 369(1651). 20130293.
. 2015. Gesture
and sign: Utterance uses of visible bodily action. In Keith Allan (ed.), The
Routledge Handbook of
Linguistics, 33–46. London: Taylor & Francis.
Landis, J. Richard & Gary G. Koch. 1977. The
Measurement of Observer Agreement for Categorical
Data. Biometrics 33(1). 159–174.
Majid, Asifa, Melissa Bowerman, Miriam van Staden & James S. Boster. 2007. The
semantic categories of cutting and breaking events: A crosslinguistic perspective. Cognitive
Linguistics 18(2). 133–152.
Marentette, Paula, Paola Pettenati, Arianna Bello & Virginia Volterra. 2016. Gesture
and symbolic representation in Italian and English-speaking Canadian 2-Year-Olds. Child
Development 87(3). 944–961.
Moneglia, Massimo. 2014. The
variation of action verbs in multilingual spontaneous speech
corpora. In Tommaso Raso & Heliana Mello (eds.), Spoken
Corpora and Linguistic Studies, 152–188. John Benjamins Publishing.
Moneglia, Massimo & Alessandro Panunzi. 2007. Action
predicates and the ontology of action across spoken language corpora. The basic issue of the SEMACT
project. In Manuel Alcántara & Thierry Declerck (eds.), Proceedings
of the International Workshop on the Semantic Representation of Spoken
Language, 51–58.
. 2010. Verbi
generali nei corpora di parlato. In Emanuela Cresti & Iørn Korzen (eds.), Cognition
and identity. Extensions of the endocentric/exocentric language
typology, 27–45. Firenze: Firenze University Press.
Müller, Cornelia. 2013. Gestural
modes of representation as techniques of depcition. In Cornelia Müller, Alan Cienki, Ellen Fricke, Silva H. Ladewig & David McNeill (eds.), Body
— language — communication: an international handbook on multimodality in human
interaction, 1687–1701. Berlin: De Gruyter Mouton.
. 2018. Gesture
and sign: Cataclysmic break or dynamic relations? Frontiers in
Psychology 9(1651). 1–20.
Nicoladis, Elena & Helena Hong Gao. 2022. How
bilinguals refer to Mandarin throwing actions in English. International Journal of
Bilingualism 26(1). 31–48.
Ortega, Gerardo & Asli Özyürek. 2020. Types
of iconicity and combinatorial strategies distinguish semantic categories in silent gesture across
cultures. Language and
Cognition 12(1). 84–113.
Özer, Demet & Tilbe Göksun. 2020. Gesture
use and processing: A review on individual differences in cognitive resources. Frontiers in
Psychology 11(573555).
Padden, Carol A., So-One Hwang, Ryan Lepic & Sharon Seegers. 2015. Tools
for Language: Patterned Iconicity in Sign Language Nouns and Verbs. Topics in Cognitive
Science 7(1). 81–94.
Padden, Carol A., Irit Meir, So-One Hwang, Ryan Lepic, Sharon Seegers & Tory Sampson. 2013. Patterned
iconicity in sign language
lexicons. Gesture 13(3). 287–308.
Panunzi, Alessandro, Irene De Felice, Lorenzo Gregori, Stefano Jacoviello, Monica Monachini, Massimo Moneglia, Valeria Quochi & Irene Russo. 2014. Translating
Action Verbs using a Dictionary of Images: the IMAGACT
Ontology. In Andrea Abel, Chiara Vettori & Natascia Ralli (eds.), Proceedings
of the XVI EURALEX International Conference: The User in
Focus, 1163–1170. Bolzano: EURAC research.
Panunzi, Alessandro & Massino Moneglia. 2004. La
variazione semantica del verbo nel lessico dei corpora di
Lablita. In Federico Albano Leoni, Francesco Cutugno, Massimo Pettorino & Renata Savy (eds.), Il
parlato italiano. Atti del Convegno nazionale di Napoli, 13–15 febbraio 2003. D’Aura Edizioni.
Perniss, Pamela, Asli Özyürek & Gary Morgan. 2015. The
influence of the visual modality on language structure and conventionalization: Insights from sign language and
gesture. Topics in Cognitive
Science 7(1). 2–11.
Perniss, Pamela, Robin L. Thompson & Gabriella Vigliocco. 2010. Iconicity
as a general property of language: Evidence from spoken and signed languages. Frontiers in
Psychology 1(227).
Pietrandrea, Paola. 2002. Iconicity
and arbitrariness in Italian Sign Language. Sign Language
Studies 2(3). 296–321.
Schultze-Berndt, Eva. 2008. What
do ‘do’ verbs do? The semantic diversity of generalised action
verbs. In Elisabeth Verhoeven, Stavros Skopetas, Yong-Min Shin, Nishina Yoko, & Johannes Helmbrecht (eds.), Studies
on
grammaticalization, vol. 2051, 185–208. Berlin: De Gruyter.
Slonimska, Anita, Asli Özyürek & Olga Capirci. 2020. The
role of iconicity and simultaneity for efficient communication: The case of Italian Sign Language
(LIS). Cognition 2001. 104246.
. 2022. Simultaneity
as an emergent property of efficient communication in language: A comparison of silent gesture and sign
language. Cognitive
Science 46(5). e13133.
Sparaci, Laura & Virginia Volterra. 2017. Hands
shaping communication: From gestures to signs. In Marta Bertolaso & Nicola Di Stefano (eds.), The
hand: Perception, cognition, action, 29–54. Cham, Switzerland: Springer International Publishing.
Tomasuolo, Elena, Chiara Bonsignori, Pasquale Rinaldi & Virginia Volterra. 2020. The
representation of action in Italian Sign Language (LIS). Cognitive
Linguistics 31(1). 1–36.
Vernillo, Paola. 2021. Grounding
abstract concepts in action: Semantic analysis of four Italian action verbs encoding force
events. In Lucas Bechberger, Kai-Uwe Kühnberger & Mingya Liu (eds.), Concepts
in
Action, 167–194. Cham: Springer International Publishing.
Volterra, Virginia, Olga Capirci, Maria Cristina Caselli, Pasquale Rinaldi & Laura Sparaci. 2017. Developmental
evidence for continuity from action to gesture to sign/word. Language, Interaction and
Acquisition 8(1). 13–41.
Volterra, Virginia, Olga Capirci, Pasquale Rinaldi & Laura Sparaci. 2018. From
action to spoken and signed language through gesture. Interaction Studies. Social Behaviour and
Communication in Biological and Artificial
Systems 19(1–2). 216–238.
Volterra, Virginia, Maria Roccaforte, Alessio Di Renzo & Sabina Fontana. 2022. Italian
Sign Language from a cognitive and socio-semiotic perspective: Implications for a general language
theory. Amsterdam: John Benjamins.
Wilcox, Sherman. 2002. William
C. Stokoe and the gestural theory of language origins. In David F. Armstrong, Michael A. Karchmer & John Vickrey Van Cleve (eds.), The
study of signed languages: Essays in honor of William C.
Stokoe, 118–130. Washington, D.C.: Gallaudet University Press.
. 2004a. Gesture
and language: Cross-linguistic and historical data from signed
languages. Gesture 4(1). 43–73.