Cover not available

Article published In: Gesture
Vol. 21:2/3 (2022) ► pp.167–200

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
EPUB logo with download linkDownload EPUB
authorization required

Gestures are modulated by social context

A study of multimodal politeness across two cultures

 | Monash University
 | Kennesaw State University
 | University of Zurich | Zurich University of Applied Sciences
 | University of Birmingham
Published online: 10 January 2023
DOI logo with link
https://doi.org/10.1075/gest.20034.bro
Abstract
This paper investigates gesture as a resource for marking politeness-related meanings. We asked 14 Korean and 14 Catalan participants to retell a cartoon, once to an unknown superior and once to a close friend. Participants in both languages curtail gestures when interacting with a socially distant superior. Speakers of both languages produced fewer gestures when addressing the superior, reduced their gesture space, decreased the encoding of manner, and reduced the use of character-viewpoint gestures. We see the decrease in gesture frequency and the less frequent encoding of manner as indicators of lower levels of iconicity when talking with status superiors. Curtailing gesture marks a less playful communicative context, and a more serious and deferential persona. Altogether, our research speaks to the importance of politeness in gesture production, and the social nature of gestures in human communication.
Article outline
  • Introduction
  • Background
    • The multimodality of politeness
    • Gesture variation
    • Gesturing in different languages and cultures
  • Methodology
    • Data collection
    • Procedure
    • Participants
    • Coding and analysis
    • Statistical analysis
  • Results
    • Gesture frequency
    • Gesture size
    • Two-handed gestures
    • Hand configuration
    • path, manner and ground
    • Viewpoint
  • General discussion
  • Conclusion
  • Acknowledgements
  • Notes
  • References
References (79)
References
Alibali, Martha W. & Don, Lisa S. (2001). Children’s gestures are meant to be seen. Gesture, 1 (2), 113–127. Google Scholar logo with link to Google Scholar
Allen, Shanley, Özyürek, Aslı, Kita, Sotaro, Brown, Amanda, Furman, Reyhan, Ishizuka, Tomoko, & Fujii, Mihoko. (2007). Language-specific and universal influences in children’s syntactic packaging of manner and path: A comparison of English, Japanese, and Turkish. Cognition, 102 (1), 16–48. Google Scholar logo with link to Google Scholar
Bavelas, Janet, Gerwing, Jennifer, Sutton, Chantelle, & Prevost, Danielle. (2008). Gesturing on the telephone: Independent effects of dialogue and visibility. Journal of Memory and Language, 58 (2), 495–520. Google Scholar logo with link to Google Scholar
Beattie, Geoffrey & Aboudan, Rima. (1994). Gestures, pauses and speech: An experimental investigation of the effects of changing social context on their precise temporal relationships. Semiotica, 99 (3/4), 239–272. Google Scholar logo with link to Google Scholar
Beattie, Geoffrey & Shovelton, Heather. (2002). An experimental investigation of some properties of individual iconic gestures that mediate their communicative power. British Journal of Psychology, 93 (2), 179–192. Google Scholar logo with link to Google Scholar
Beaulieu, Catherine. (2004). Intercultural study of personal space: A case study. Journal of Applied Social Psychology, 34 (4), 794–805. Google Scholar logo with link to Google Scholar
Blokpoel, Mark, van Kesteren, Marlieke, Stolk, Arjen, Haselager, Pim, Toni, Ivan, & Van Rooij, Iris. (2012). Recipient design in human communication: Simple heuristics or perspective taking? Frontiers in Human Neuroscience, 61, 253. Google Scholar logo with link to Google Scholar
Brown, Amanda & Chen, Jidong. (2013). Construal of Manner in speech and gesture in Mandarin, English, and Japanese. Cognitive Linguistics, 24 (4), 605–631. Google Scholar logo with link to Google Scholar
Brown, Lucien. (2011). Korean honorifics and politeness in second language learning. Amsterdam & Philadelphia: John Benjamins Publishing Company. Google Scholar logo with link to Google Scholar
. (2015). Honorifics and politeness. In Lucien Brown & Jaehoon Yeon (Eds.), The handbook of Korean linguistics (pp. 303–319). New York: Wiley. Google Scholar logo with link to Google Scholar
Brown, Lucien & Prieto, Pilar. (2017). (Im)politeness: Prosody and gesture. In Jonathan Culpeper, Michael Haugh, & Daniel Kádár (Eds.), The Palgrave handbook of linguistic (im)politeness (pp. 357–379). London: Palgrave Macmillan. Google Scholar logo with link to Google Scholar
Brown, Lucien & Winter, Bodo. (2019). Multimodal indexicality in Korean: “Doing deference” and “performing intimacy” through nonverbal behavior. Journal of Politeness Research, 15 (1), 25–54. Google Scholar logo with link to Google Scholar
Brown, Lucien, Winter, Bodo, Idemaru, Kaori, & Grawunder, Sven. (2014). Phonetics and politeness: Perceiving Korean honorific and non-honorific speech through phonetic cues. Journal of Pragmatics, 661, 45–60. Google Scholar logo with link to Google Scholar
Brown, Penelope. (2015). Politeness and language. In James D. Wright (Ed.), The international encyclopedia of the social and behavioral sciences (IESBS) (2nd Ed., Vol. 181, pp. 326–330). Amsterdam: Elsevier. Google Scholar logo with link to Google Scholar
Brown, Penelope & Levinson, Stephen. (1987). Politeness: Some universals in language usage. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Burgoon, Judee K. & Dunbar, Norah E. (2006). Nonverbal expressions of dominance and power in human relationships. In Valerie Manusov & Miles L. Patterson (Eds.), The Sage handbook of nonverbal communication (pp. 279–297). Thousand Oaks, CA: Sage Publishers. Google Scholar logo with link to Google Scholar
Bürkner, Paul-Christian. (2017). brms: An R package for Bayesian multilevel models using Stan. Journal of Statistical Software, 80 (1), 1–28. Google Scholar logo with link to Google Scholar
Christie, Christine. (2018). The indexical scope of adios: A relevance theoretic analysis of discursive constructions of gender and institutions and their impact on utterance interpretation. Journal of Politeness Research, 14 (1), 97–119. Google Scholar logo with link to Google Scholar
Chu, Mingyuan, Meyer, Antje, Foulkes, Lucy, & Kita, Sotaro. (2014). Individual differences in frequency and saliency of speech-accompanying gestures: The role of cognitive abilities and empathy. Journal of Experimental Psychology: General, 143 (2), 694–709. Google Scholar logo with link to Google Scholar
Cook, Haruko Minegishi. (2008). Socializing identities through speech style: Learners of Japanese as a foreign language. Bristol: Multilingual Matters. Google Scholar logo with link to Google Scholar
Dalmau, Maria Sabaté i & Gotor, Hortènsia Curell i. (2007). From “Sorry very much” to “I’m ever so sorry”: Acquisitional patterns in L2 apologies by Catalan learners of English. Intercultural Pragmatics, 4 (2), 287–315. Google Scholar logo with link to Google Scholar
Dennison, Heeyon Y. & Bergen, Benjamin K. (2010). Language-driven motor simulation is sensitive to social context. Proceedings of the Annual Meeting of the Cognitive Science Society, 321, 901–906.Google Scholar logo with link to Google Scholar
Dingemanse, Mark & Thompson, Bill. (2020). Playful iconicity: Structural markedness underlies the relation between funniness and iconicity. Language and Cognition, 12 (1), 203–224. Google Scholar logo with link to Google Scholar
ELAN (Version 6.0). (2020). Nijmeden: Max Planck Institute for Psycholinguistics.Google Scholar logo with link to Google Scholar
Galati, Alexia & Brennan, Susan E. (2014). Speakers adapt gestures to addressees’ knowledge: Implications for models of co-speech gesture. Language, Cognition and Neuroscience, 29 (4), 435–451. Google Scholar logo with link to Google Scholar
Goldin-Meadow, Susan & Saltzman, Jody. (2000). The cultural bounds of maternal accommodation: How Chinese and American mothers communicate with deaf and hearing children. Psychological Science, 11 (4), 307–314. Google Scholar logo with link to Google Scholar
Goldsmith, Daena J. (2007). Brown and Levinson’s politeness theory. In Bryan B. Whaley & Wendy Samter (Eds.), Explaining communication: Contemporary theories and exemplars (pp. 219–236). Mahwah, NJ: Erlbaum.Google Scholar logo with link to Google Scholar
Guerrero, Laura K. & Floyd, Kory. (2006). Nonverbal communication in close relationships. Mahwah, NJ: Erlbaum. Google Scholar logo with link to Google Scholar
Holler, Judith, Tutton, Mark, & Wilkin, Katie. (2011). Co-speech gestures in the process of meaning coordination. In 2nd Gesture & Speech in Interaction (GeSpin). [URL]
Holler, Judith & Wilkin, Katie. (2009). Communicating common ground: How mutually shared knowledge influences speech and gesture in a narrative task. Language and Cognitive Processes, 24 (2), 267–289. Google Scholar logo with link to Google Scholar
Holtgraves, Thomas & Yang, Joong-Nam. (1992). Interpersonal underpinnings of request strategies: General principles and differences due to culture and gender. Journal of Personality and Social Psychology, 62 (2), 246. Google Scholar logo with link to Google Scholar
Hübscher, Iris, Borràs-Comes, Joan, & Prieto, Pilar. (2017). Prosodic mitigation characterizes Catalan formal speech: The Frequency Code reassessed. Journal of Phonetics, 651, 145–159. Google Scholar logo with link to Google Scholar
Hübscher, Iris, Sánchez-Conde, Cristina, Borràs-Comes, Joan, Vincze, Laura, & Prieto, Pilar. (forthcoming). Multimodal mitigation: How facial and body cues index social meaning in Catalan requests. Journal of Politeness Research.
Idemaru, Kaori, Winter, Bodo, & Brown, Lucien. (2019). Cross-cultural multimodal politeness: The phonetics of Japanese deferential speech in comparison to Korean. Intercultural Pragmatics, 16 (5), 517–555. Google Scholar logo with link to Google Scholar
Idemaru, Kaori, Winter, Bodo, Brown, Lucien, & Oh, Grace Eunhae. (2020). Loudness trumps pitch in politeness judgments: Evidence from Korean deferential speech. Language and Speech, 63 (1), 123–148. Google Scholar logo with link to Google Scholar
Iverson, Jana M., Capirci, Olga, Volterra, Virginia, & Goldin-Meadow, Susan. (2008). Learning to talk in a gesture-rich world: Early communication in Italian vs. American children. First Language, 28 (2), 164–181. Google Scholar logo with link to Google Scholar
Jacobs, Naomi & Garnham, Alan. (2007). The role of conversational hand gestures in a narrative task. Journal of Memory and Language, 56 (2), 291–303. Google Scholar logo with link to Google Scholar
Kádár, Dániel Z. & Haugh, Michael. (2013). Understanding politeness. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Kelly, Spencer, Byrne, Kelly, & Holler, Judith. (2011). Raising the ante of communication: Evidence for enhanced gesture use in high stakes situations. Information, 2 (4), 579–593. Google Scholar logo with link to Google Scholar
Kiesling, Scott F. (2004). Dude. American Speech, 79 (3), 281–305. Google Scholar logo with link to Google Scholar
Kita, Sotaro. (2000). How representational gestures help speaking. Language and Gesture, 11, 162–185. Google Scholar logo with link to Google Scholar
. (2009). Cross-cultural variation of speech-accompanying gesture: A review. Language and Cognitive Processes, 24 (2), 145–167. Google Scholar logo with link to Google Scholar
Kita, Sotaro & Ide, Sachiko. (2007). Nodding, aizuchi, and final particles in Japanese conversation: How conversation reflects the ideology of communication and social relationships. Journal of Pragmatics, 39 (7), 1242–1254. Google Scholar logo with link to Google Scholar
Kita, Sotaro & Özyürek, Aslı. (2003). What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 48 (1), 16–32. Google Scholar logo with link to Google Scholar
Koo, Jasook. (1995). Politeness theory: Universality and specificity. Doctoral dissertation, Harvard University, Cambridge, MA.
Krahmer, Emiel & Swerts, Marc. (2007). The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception. Journal of Memory and Language, 57 (3), 396–414. Google Scholar logo with link to Google Scholar
Leech, Geoffrey N. (2016). Principles of pragmatics. London: Routledge. Google Scholar logo with link to Google Scholar
McNeill, David. (1992). Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.Google Scholar logo with link to Google Scholar
. (2005). Gesture and thought. Chicago: University of Chicago Press. Google Scholar logo with link to Google Scholar
McNeill, David & Duncan, Susan D. (2000). Growth points in thinking-for-speaking. In David McNeill (Ed.), Language and gesture (pp. 141–161). Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Nadeu, Marianna & Prieto, Pilar. (2011). Pitch range, gestural information, and perceived politeness in Catalan. Journal of Pragmatics, 43 (3), 841–854. Google Scholar logo with link to Google Scholar
Newman-Norlund, Sarah E., Noordzij, Matthijs L., Newman-Norlund, Roger D., Volman, Inge A. C., de Ruiter, Jan Peter, Hagoort, Peter, & Toni, Ivan. (2009). Recipient design in tacit communication. Cognition, 111 (1), 46–54. Google Scholar logo with link to Google Scholar
Nicoladis, Elena, Nagpal, Jaya, Marentette, Paula, & Hauer, Brandon. (2018). Gesture frequency is linked to story-telling style: Evidence from bilinguals. Language and Cognition, 10 (4), 641–664. Google Scholar logo with link to Google Scholar
Ochs, Elinor. (1993). Constructing social identity: A language socialization perspective. Research on Language and Social Interaction, 26 (3), 287–306. Google Scholar logo with link to Google Scholar
Orie, Ọlanikẹ Ọla. (2009). Pointing the Yoruba way. Gesture, 9 (2), 237–261. Google Scholar logo with link to Google Scholar
Özyürek, Aslı. (2002). Do speakers design their cospeech gestures for their addressees? The effects of addressee location on representational gestures. Journal of Memory and Language, 46 (4), 688–704. Google Scholar logo with link to Google Scholar
Özyürek, Aslı, Kita, Sotaro, Allen, Shanley, Brown, Amanda, Furman, Reyhan, & Ishizuka, Tomoko. (2008). Development of cross-linguistic variation in speech and gesture: Motion events in English and Turkish. Developmental Psychology, 44 (4), 1040. Google Scholar logo with link to Google Scholar
Özyürek, Aslı, Hickman, M., Veneziano, E., & Jisa, H. (2018). Cross-linguistic variation in children’s multimodal utterances. In Maya Hickmann, Edy Veneziano, & Harriet Jisa (Eds.), Sources of variation in first language acquisition: Languages, contexts, and learners (pp. 123–138). Amsterdam & Philadelphia: John Benjamins. Google Scholar logo with link to Google Scholar
Parrill, Fey. (2010a). The hands are part of the package: Gesture, common ground, and information packaging. In Sally Rice & John Newman (Eds.), Empirical and experimental methods in cognitive/functional research (pp. 285–302). Stanford, CA: CSLI Publications.Google Scholar logo with link to Google Scholar
. (2010b). Viewpoint in speech–gesture integration: Linguistic structure, discourse structure, and event structure. Language and Cognitive Processes, 25 (5), 650–668. Google Scholar logo with link to Google Scholar
Paxton, Alexandra & Dale, Rick. (2013). Frame-differencing methods for measuring bodily synchrony in conversation. Behavior Research Methods, 45 (2), 329–343. Google Scholar logo with link to Google Scholar
Peirce, Charles S. (1940). The philosophical Peirce: Selected writings (Justus Buchler, Ed.). New York: Harcourt, Brace.Google Scholar logo with link to Google Scholar
Pizziconi, Barbara & Christie, Chris. (2017). Indexicality and (im)politeness. In Jonathan Culpeper, Michael Haugh, & Daniel Kádár (Eds.), The Palgrave handbook of linguistic (Im)politeness (pp. 143–170). London: Palgrave Macmillan. Google Scholar logo with link to Google Scholar
R Core Team. (2019). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. [URL]
Ren-Mitchell, Ada. (2019). Gesture coding manual. [URL]
Silverstein, Michael. (2003). Indexical order and the dialectics of social life. Language and Communication, 231, 193–229. Google Scholar logo with link to Google Scholar
So, Wing Chee. (2010). Cross-cultural transfer in gesture frequency in Chinese–English bilinguals. Language and Cognitive Processes, 25 (10), 1335–1353. Google Scholar logo with link to Google Scholar
Sohn, Ho-Min. (2001). The Korean Language. Cambridge: Cambridge University Press.Google Scholar logo with link to Google Scholar
Stein, Nancy & Glenn, Christine. (1979). An analysis of story comprehension in elementary school children. In Roy Freedle (Ed.), New directions in discourse processing (pp. 53–120). Norwood, NJ: Ablex. [URL]
Talmy, Leonard. (1985). Lexicalization patterns: Semantic structure in lexical forms. Language Typology and Syntactic Description, 3 (99), 36–149.Google Scholar logo with link to Google Scholar
Wickham, Hadley, Averick, Mara, Bryan, Jennifer, Chang, Winston, McGowan, Lucy D’Agostino, François, Romain, […], & Hester, Jim. (2019). Welcome to the Tidyverse. Journal of Open Source Software, 4 (43), 1686. [URL].
Winter, Bodo. (2019). Statistics for linguists: An introduction using R. New York, NY: Routledge. Google Scholar logo with link to Google Scholar
Winter, Bodo & Bürkner, Paul-Christian. (2021). Poisson regression for linguists: A tutorial introduction to modeling count data with brms. Language and Linguistics Compass, e12439.
Winter, Bodo & Grawunder, Sven. (2012). The phonetic profile of Korean formal and informal speech registers. Journal of Phonetics, 40 (6), 808–815. Google Scholar logo with link to Google Scholar
Withey, Alun. (2015). Technology, self-fashioning and politeness in eighteenth-century Britain: Refined bodies. Basingstoke, Hampshire & New York, NY: Palgrave Macmillan. Google Scholar logo with link to Google Scholar
Woodin, Greg, Winter, Bodo, Perlman, Marcus, Littlemore, Jeannette, & Matlock, Teenie. (2020). “Tiny numbers” are actually tiny: Evidence from gestures in the TV News Archive. Plos One, 15 (11), e0242142. Google Scholar logo with link to Google Scholar
Cited by (15)

Cited by 15 other publications

Brown, Lucien & Soyeon Kim
2025. Intercultural Im/politeness: perceptions of language choice and translanguaging in the Korean community in Australia. Journal of Politeness Research 21:1 ► pp. 193 ff. DOI logo
Brown, Lucien, Grace Eunhae Oh & Kaori Idemaru
2025. Prosodic features of polite speech. Pragmatics. Quarterly Publication of the International Pragmatics Association (IPrA) 35:3 ► pp. 321 ff. DOI logo
Cavents, Dries, July De Wilde & Jelena Vranjes
2025. Towards a multimodal approach for analysing interpreter's management of rapport challenge in onsite and video remote interpreting. Journal of Pragmatics 235 ► pp. 220 ff. DOI logo
Cavents, Dries, Jelena Vranjes & July De Wilde
2025. Interpreters’ use of embodied resources to manage rapport challenge in video remote interpreting. Perspectives ► pp. 1 ff. DOI logo
Hensel, Laura B., Stephanie Cheng & Stacy Marsella
2025. A richly annotated dataset of co-speech hand gestures across diverse speaker contexts. Scientific Data 12:1 DOI logo
Li, Heng
2025. All flesh is equal. Review of Cognitive Linguistics DOI logo
Murillo Murillo , Olga Mercedes, Bryan Saul Nay Betancourt , Darwin Israel Resabala Chila, Lenin Esteban Loaiza Dávila & Giceya De La Caridad Maqueira Caraball
2025. Gestural codes in the inclusion of students with autism in the physical education class. Salud, Ciencia y Tecnología 5 ► pp. 1329 ff. DOI logo
Llopis Cardona, Ana, Iris Hübscher & Adrián Cabedo Nebot
2024. A Multimodal Approach to Catalan Pragmatic Markers: An Exploratory Study. Languages 9:4 ► pp. 125 ff. DOI logo
Lopez-Ozieblo, Renia
2024. Is personality reflected in the gestures of second language speakers?. Frontiers in Psychology 15 DOI logo
Skrzek, Tomasz, Filip Malawski, Slawomir K. Tadeja, Daniela Hekiert, Daria Hemmerling & Magdalena Igras-Cybulska
2024. 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), ► pp. 624 ff. DOI logo
Ünal, Ercenur, Ezgi Mamus & Aslı Özyürek
2024. Multimodal encoding of motion events in speech, gesture and cognition. Language and Cognition 16:4 ► pp. 785 ff. DOI logo
Dyrmo, Tomasz
2023. Levels of metaphor in gesture. Pragmatics & Cognition 30:2 ► pp. 330 ff. DOI logo
Dyrmo, Tomasz
2024. Image schemas in gestural metaphorical scenarios of swearing. Multimodal Communication 13:2 ► pp. 117 ff. DOI logo
Pabst, Alexandria, Taylor Tabb, Kenneth Michael Stewart & Andreea Danielescu
2023. Proceedings of the 2023 ACM Designing Interactive Systems Conference, ► pp. 2155 ff. DOI logo
Vergis, Nikos
2023. How affect modulates conversational meanings: a review of experimental research: invited review. Cognition and Emotion ► pp. 1 ff. DOI logo

This list is based on CrossRef data as of 9 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue