Cover not available

Article published In: Gesture
Vol. 22:3 (2023) ► pp.262–287

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
EPUB logo with download linkDownload EPUB
authorization required

Do speakers’ gestures affect listeners’ understanding of temporal relationships between events?

 | Waseda University
ORCiD logo with link | Waseda University
Published online: 30 September 2024
DOI logo with link
https://doi.org/10.1075/gest.23020.yos
Abstract
This study investigated how the direction and movement of gestures affect mental representations of time. Previous research by Tversky, B., & Jamalian, A. (2021). Thinking tools: gestures change thought about time. Topics in Cognitive Science, 131, 750–776. Google Scholar logo with link to Google Scholar demonstrated that gestures influence how people perceive temporal relationships, with participants’ drawings reflecting the shape (circular or linear) of the gestures they observed. However, the influence of gesture direction was not examined. In the present study, 50 Japanese adults were exposed to different types of gestures, including leftward and rightward linear or circular gestures. Participants were then asked to draw diagrams representing the temporal flow of events. The results showed significant associations between the type of gesture and the participants’ drawings. Specifically, the direction and form of the gestures — whether leftward or rightward, linear or circular — significantly influenced how participants depicted temporal relationships. These findings highlight the importance of both gesture direction and movement in shaping individuals’ mental representations of time.
Article outline
  • Background
  • Method
    • Participants
    • Experimental design
    • Experimental material
    • Experimental equipment
    • Procedure
  • Results
    • Relationship between gesture type and drawing response
    • Analysis of diagrams drawn by experimental participants
    • Analysis of congruence between the presented gesture and drawn response
  • Discussion
    • Pattern of responses
    • Congruence
    • Relationship with story content
    • Future directions
  • References
References (20)
References
Alcaraz Carrión, D. & Valenzuela, J. (2021). Distant time, distant gesture: speech and gesture correlate to express temporal distance. Semiotica, 2411, 159–183. Google Scholar logo with link to Google Scholar
Boroditsky, L., & Ramscar, M. (2002). The roles of body and mind in abstract thought. Psychological Science, 13(2), 185–189. Google Scholar logo with link to Google Scholar
Bergen, B. K., & Lau, T. T. C. (2012). Writing direction affects how people map space onto time. Frontiers in psychology, 3, 109, 1–5. Google Scholar logo with link to Google Scholar
Callizo-Romero, C., Tutnjević, S., Pandza, M., Ouellet, M., Kranjec, A., Ilić, S., Gu, Y., Göksun, T., Chahboun, S., Casasanto, D., & Santiago, J. (2022). Does time extend asymmetrically into the past and the future? A multitask crosscultural study. Language and Cognition, 14(2), 275–302. Google Scholar logo with link to Google Scholar
Casasanto, D., & Bottini, R. (2014). Spatial language and abstract concepts. WIREs Cognitive Science, 51, 139–149. Google Scholar logo with link to Google Scholar
Casasanto, D., & Jasmin, K. (2012). The hands of time: Temporal gestures in English speakers. Cognitive Linguistics, 23(4), 643–674. Google Scholar logo with link to Google Scholar
Clark, H. H. (1973). Space, time, semantics, and the child. In T. E. Moore (Ed.), Cognitive development and the acquisition of language (pp. 27–63). New York: Academic Press. Google Scholar logo with link to Google Scholar
de la Fuente, J., Santiago, J., Román, A., Dumitrache, C., & Casasanto, D. (2014). When you think about it, your past is in front of you: How culture shapes spatial conceptions of time. Psychological Science, 25(9), 1682–1690. Google Scholar logo with link to Google Scholar
Feist, M. I., & Duffy, S. E. (2023). To each their own: A review of individual differences and metaphorical perspectives on time. Frontiers in Psychology. 141:1213719. Google Scholar logo with link to Google Scholar
Gu, Y., Mol, L., Hoetjes, H., & Swerts, M. (2017). Conceptual and lexical effects on gestures: The case of vertical spatial metaphors for time in Chinese. Language, Cognition and Neuroscience, 32(8), 1048–1063. Google Scholar logo with link to Google Scholar
Kugelmass, S. & Lieblich, A. (1979). Impact of learning to read on directionality in perception: A further cross-cultural analysis. Human development, 22(6), 406–415. Google Scholar logo with link to Google Scholar
Miles, L. K., Tan, L., Noble, G. D. (2011). Can a mind have two time lines? Exploring space-time mapping in Mandarin and English speakers. Psychonomic Bulletin & Review, 181, 598–604. Google Scholar logo with link to Google Scholar
Núñez, R. E., Cooperrider, K., Doan, D., & Wassmann, J. (2012). Contours of time: Topographic construals of past, present, and future in the Yupno Valley of Papua New Guinea. Cognition, 124(1), 25–35. Google Scholar logo with link to Google Scholar
Núñez, R. E., Motz, B. A., & Teuscher, U. (2006). Time after time: The psychological reality of the ego — and time-reference-point distinction in metaphorical construals of time. Metaphor and Symbol, 21(3), 133–146. Google Scholar logo with link to Google Scholar
Pagán Cánovas, C., Valenzuela, J., Alcaraz Carrión, D., Olza, I., & Ramscar, M. (2020). Quantifying the speech-gesture relation with massive multimodal datasets: Informativity in time expressions. PLOS ONE 15(6): e0233892. Google Scholar logo with link to Google Scholar
Sekine, K., Sowden, H., & Kita, S. (2015). The Development of the ability to semantically integrate information in speech and iconic gesture in comprehension. Cognitive Science, 39(8), 1855–1880. Google Scholar logo with link to Google Scholar
Stites, L., & Özçalışkan, Ş. (2021). The time is at hand: literacy predicts changes in children’s gestures about time. Journal of Psycholinguistic Research, 501, 967–983. Google Scholar logo with link to Google Scholar
Tversky, B., & Jamalian, A. (2021). Thinking tools: gestures change thought about time. Topics in Cognitive Science, 131, 750–776. Google Scholar logo with link to Google Scholar
Tversky, B., Kugelmass, S., & Winter, A. (1991). Cross-cultural and developmental trends in graphic productions. Cognitive Psychology, 23(4), 515–557. Google Scholar logo with link to Google Scholar
Winter, B., & Duffy, S. E. (2020). Can co-speech gestures alone carry the mental time line? Journal of Experimental Psychology: Learning, Memory, and Cognition, 46(9), 1768–1781. Google Scholar logo with link to Google Scholar
Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue