Cover not available

In:Constructing Families of Constructions: Analytical perspectives and theoretical challenges
Edited by Francisco José Ruiz de Mendoza Ibáñez, Alba Luzondo Oyón and Paula Pérez-Sobrino
[Human Cognitive Processing 58] 2017
► pp. 301–337

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload Book PDF
authorization required

Chapter 10
Multimodal constructional resemblance

The case of English circular motion constructions

 | University of Freiburg
Published online: 26 July 2017
DOI logo with link
https://doi.org/10.1075/hcp.58.11zim
Abstract
This chapter approaches the topic of constructional families by zooming in on five English motion constructions. Contrary to the traditional focus of Construction Grammar on verbal form-meaning pairings, the chapter discusses their multimodal dimension. A study in the NewsScape Library of Television News Broadcasts (Steen and Turner 2013) reveals that all five motion constructions studied therein show high co-occurrence rates with manner and path gestures. It is argued that according to the basic premises of Construction Grammar and the usage-based approach, co-speech motion gesture use is a defining part of these constructions. In support of this view, the chapter focuses on the influence of semantic readings, genre, and the broader discourse sequences’ degree of interactionality on co-speech motion gesture use.
Article outline
  • 1.Introduction
  • 2.Multimodality and Construction Grammar
  • 3.Outline of the chapter
  • 4.The role of gesture in motion event descriptions
  • 5.The data study
    • 5.1Data selection and coding parameters
    • 5.2Results of the data study
      • 5.2.1Overall gesture frequencies and gesture forms
      • 5.2.2Gesture semantics: Path, manner, and conflated gestures
      • 5.2.3Interim summary
      • 5.2.4Constructional semantic readings and gesture frequencies
      • 5.2.5Genre, interactionality, and gesture frequencies
  • 6.Multimodal constructions or manner modulation?
  • 7.Conclusions
  • Acknowledgments
  • Notes
  • References
References (76)
References
Andrén, M. 2010. Children’s gestures from 18 to 30 months. PhD thesis. Lund University: Centre for Languages and Literature.Google Scholar logo with link to Google Scholar
Beckner, C., Blythe, R., Bybee, J., Christiansen, M., Croft, W., Ellis, N., Holland, J., Ke, J., Larsen-Freeman, D., & Schoenemann, T. 2009. Language as a complex adaptive system: Position Paper. Language Learning, 59(1), 1–26.Google Scholar logo with link to Google Scholar
Bressem, J. 2013. A linguistic perspective on the notation of form features in gestures. In C. Müller, A. Cienki, E. Fricke, S. H. Ladewig, D. McNeill, & J. Bressem (Eds.), Body – Language – Communication. An international handbook on multimodality in human interaction (1079–1098). Berlin & New York: Mouton de Gruyter.Google Scholar logo with link to Google Scholar
Bressem, J., & Müller, C. 2014. The “negative-assessment-construction”: A multimodal pattern. Presentation at GCLA 6, Erlangen, Nurnberg.Google Scholar logo with link to Google Scholar
Brown, A., & Chen, J. 2013. Construal of Manner in Speech and Gesture in Mandarin, English, and Japanese. Cognitive Linguistics, 23(4), 605–631.Google Scholar logo with link to Google Scholar
Brown, A., & Gullberg, M. 2008. Bidirectional crosslinguistic influence in L1- L2 encoding of manner in speech and gesture: A study of Japanese speakers of English. Studies in Second Language Acquisition, 30(2), 225–251. Google Scholar logo with link to Google Scholar
Butcher, C., & Goldin-Meadow, S. 2000. Gesture and the transition from one- to two-word speech: When hand and mouth come together. In D. McNeill (Ed.), Language and gesture (235–257). New York: Cambridge University Press. Google Scholar logo with link to Google Scholar
Bybee, J. 2006. From usage to grammar. The mind’s response to repetition. Language, 82, 711–733. Google Scholar logo with link to Google Scholar
Cavicchio, F., Brown, A., Furman, R., Allen, S., Özyürek, A., & Kita, S. 2014. Annotation of space and manner/path configuration in bilinguals’ speech and manual gestures. Proceedings of the 10th International Workshop on Multimodal Corpora, Tools and Resources, 25–28.Google Scholar logo with link to Google Scholar
Chafe, W. 1994. Discourse, consciousness, and time: the flow and displacement of conscious experience in speaking and writing. Chicago: University of Chicago Press.Google Scholar logo with link to Google Scholar
Chen, L., & Guo, J. 2009. Motion events in Chinese novels: Evidence for an equipollently-framed language. Journal of Pragmatics, 41, 1749–1766. Google Scholar logo with link to Google Scholar
Cienki, A. 2002. Questions about mental imagery, gesture, and image schemas. Journal of Mental Imagery, 26, 43–46.Google Scholar logo with link to Google Scholar
2012. Usage events of spoken language and the symbolic units we (may) abstract from them. In J. Badio, & K. Kosecki (Eds.), Cognitive processes in language (149–158). Bern: Peter Lang.Google Scholar logo with link to Google Scholar
2015. Spoken language usage events. Language and Cognition, 7(4), 499–514. Google Scholar logo with link to Google Scholar
Cienki, A., & Müller, C. (Eds.). 2008. Metaphor and gesture. Amsterdam & Philadelphia: John Benjamins. Google Scholar logo with link to Google Scholar
Corballis, M. C. 2002. From hand to mouth: The origins of language. Princeton, NJ: Princeton University Press.Google Scholar logo with link to Google Scholar
Dancygier, B., & Sweester, E. (Eds). 2012. Viewpoint in language: A multimodal perspective. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Diessel, H. 2015. Usage-based construction grammar. In E. Dabrowska, & D. Divjak (Eds.), Handbook of Cognitive Linguistics (295–321). Berlin: Mouton de Gruyter. Google Scholar logo with link to Google Scholar
Duncan, S. 2006. Co-expressivity of speech and gesture: Manner of motion in Spanish, English, and Chinese. Proceedings of the 27th Berkeley Linguistic Society Annual Meeting, 353–370.Google Scholar logo with link to Google Scholar
Fauconnier, G., & Turner, M. 2002. The way we think. New York: Basic Books.Google Scholar logo with link to Google Scholar
Filipović, L. 2015. Talking about motion. Amsterdam & Philadelphia: John Benjamins.Google Scholar logo with link to Google Scholar
Forceville, C., & Urios-Aparisi, E. 2009. Multimodal Metaphor. Berlin & New York: Mouton de Gruyter. Google Scholar logo with link to Google Scholar
Goldberg, A. 1995. Constructions: A Construction Grammar approach to argument structure. Chicago: University of Chicago Press.Google Scholar logo with link to Google Scholar
2003. Constructions: A new theoretical approach to language. Trends in Cognitive Science, 7, 219–224. Google Scholar logo with link to Google Scholar
2006. Constructions at work: The nature of generalization in language. Oxford: Oxford University Press.Google Scholar logo with link to Google Scholar
Goldin-Meadow, S. 1997. When gesture and words speak differently. Current Directions in Psychological Science, 6, 138–143. Google Scholar logo with link to Google Scholar
2013. How our gestures help us learn. In C. Müller, A. Cienki, E. Fricke, S. H. Ladewig, D. McNeill, & S. Teßendorf (Eds.), Body – language – communication: An international handbook on multimodality in human interactio. (792–803). Berlin: De Gruyter Mouton.Google Scholar logo with link to Google Scholar
Healey, M. L., & Braun, A. R. 2013. Shared neural correlates for speech and gesture, functional brain mapping and the endeavor to understand the working brain, Available from: [URL]
Hickmann, M., Hendriks, H., & Gullberg, M. 2011. How to talk and gesture about motion in French and English: cross-linguistic and developmental perspectives. Language, interaction et acquisition, 2,1. Grammaticalization and language acquisition: Nouns and verbs across languages, 2(11), 29–156.Google Scholar logo with link to Google Scholar
Hilpert, M. 2014. Construction Grammar and its application to English. Edinburgh: Edinburgh University Press.Google Scholar logo with link to Google Scholar
Imo, W. 2015. Was ist (k)eine Konstruktion? In C. Dürscheid, & Scheider, J. G. (Eds.), Handbuch, Satz, Äusserung, Schema (551–576). Berlin: Mouton de Gruyter. Google Scholar logo with link to Google Scholar
Iverson, J. M., & Fagan, M. K. 2004. Infant vocal-motor coordination: Precursor to the gesture-speech system? Child Development, 75, 1053–1066 Google Scholar logo with link to Google Scholar
Kellermann, E., & Van Hoof, A. 2003. Manual accents. International Review of Applied Linguistics, 41, 251–269. Google Scholar logo with link to Google Scholar
Kendon, A. 2004. Gesture: Visible action as utterance. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Kita, S., & Özyürek, A. 2003. What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 48(1), 16 Gesture: Visible 32.Google Scholar logo with link to Google Scholar
Kita, S., Özyürek, A., Allen, S., Brown, A., Furman, R., & Ishizuka, T. 2007. Relations between syntactic encoding and co-speech gestures: Implications for a model of speech and gesture production. Language and Cognitive Processes, 22(8), 1212 Gesture: Visible 1236.Google Scholar logo with link to Google Scholar
Koestler, A. 1964. The act of creation. New York: Penguin Books.Google Scholar logo with link to Google Scholar
Kövesces, Z. 2010. Metaphor. A practical introduction. Oxford: Oxford University Press.Google Scholar logo with link to Google Scholar
Ladewig, S. H. 2014. The cyclic gestures. In C. Müller, A. Cienki, E. Fricke, S. H. Ladewig, D. McNeill, & J. Bressem (Eds.), Body-Language-Communication: An international handbook on multimodality in human interaction (1605–1617). Berlin & Boston: Mouton de Gruyter.Google Scholar logo with link to Google Scholar
Lakoff, G., & Johnson, M. 1999. Philosophy in the flesh: The embodied mind and its challenge to western thought. NY: Basic Books.Google Scholar logo with link to Google Scholar
Landis, J. R., & Koch, G. G. 1977. The measurement of observer agreement for categorical data. Biometrics, 33, 159–174. Google Scholar logo with link to Google Scholar
Langacker, R. W. 1987. Foundations of Cognitive Grammar: Theoretical prerequisites. Volume 1. Stanford: Stanford University Press.Google Scholar logo with link to Google Scholar
2000. Grammar and conceptualization. Berlin & New York: Mouton de Gruyter.Google Scholar logo with link to Google Scholar
2005. Construction Grammars: Cognitive, radical, and less So. In F. Ruiz de Mendoza, & M. S. Peña (Eds.), Cognitive Linguistics: Internal dynamics and interdisciplinary interaction (101–159). Berlin & New York: Mouton de Gruyter.Google Scholar logo with link to Google Scholar
Mani, I. & Pustejovsky, J. 2012. Interpreting motion. Oxford: Oxford University Press.Google Scholar logo with link to Google Scholar
McNeill, D. 1985. So you think gestures are nonverbal? Psychological Review, 92(3), 350–371. Google Scholar logo with link to Google Scholar
1992. Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.Google Scholar logo with link to Google Scholar
2001. Imagery in motion event descriptions: Gestures as part of thinking-for-speaking in three languages. Proceedings of the Twenty-Third Annual Meeting of the Berkeley Linguistics Society, 255–267.Google Scholar logo with link to Google Scholar
2005. Gesture and thought. Chicago: University of Chicago Press. Google Scholar logo with link to Google Scholar
McNeill, D., & Duncan, S. 2000. Growth points in thinking-for-speaking. In D. McNeill (Ed.), Language and gesture (141–161). Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Mittelbeg, I. 2006. Metaphor and metonymy in language and gesture: Discourse evidence for multimodal models of grammar. PhD Dissertation, Cornell University. Published online, Ann Arbor, MI: ProQuest/UMI.Google Scholar logo with link to Google Scholar
Mittelberg, I. 2014. Multimodal existential constructions in German and English. Presentation at GCLA 6, Erlangen, Nurnberg.Google Scholar logo with link to Google Scholar
Negueruela, E., Lantolf, J., Jordan, S., & J. Gelabert. 2004. The “private function” of gesture in second language speaking activity: A study of motion verbs and gesturing in English and Spanish. International Journal of Applied Linguistics, 14(1), 113–147. Google Scholar logo with link to Google Scholar
Özyürek, A., Kita, S., Allen, S., Furman, R., & Brown, A. 2005. How does linguistic framing influence co-speech gestures? Insights from crosslinguistic differences and similarities. Gesture, 5(1/2), 216–241.Google Scholar logo with link to Google Scholar
Parrill, F. 2010. Viewpoint in speech-gesture integration: Linguistic structure, discourse structure, and event structure. Language and Cognitive Processes, 25(5), 650–668. Google Scholar logo with link to Google Scholar
Pragglejaz Group. 2007. MIP: A Method for Identifying Metaphorically Used Words in Discourse. Metaphor and Symbol, 22(1), 1–39. Google Scholar logo with link to Google Scholar
Sacks, H. 1992. Lectures on conversation. Cambridge, MA: Blackwell.Google Scholar logo with link to Google Scholar
Schoonjans, S. 2014. Modalpartikeln als multimodale Konstruktionen. Eine korpusbasierte Kookkurrenzanalyse von Modalpartikeln und Gestik im Deutschen. Unpublished dissertation. University of Leuven.Google Scholar logo with link to Google Scholar
Selting, M., Auer, P., Barth-Weingarten, D., Bergmann, J. R., Bergmann, P., Birkner, K., Couper-Kuhlen, E., Deppermann, A., Gilles, P., Günthner, S., Hartung, M. 2009. Gesprächsanalytisches Transkriptionssystem 2 (GAT 2). Gesprächsforschung – Online-Zeitschrift zur verbalen Interaktion, 10, 353–402.Google Scholar logo with link to Google Scholar
Slobin, D. I. 2004. The many ways to search for a frog: Linguistic typology and the expression of motion events. In S. Strömqvist, & L. Verhoeven (Eds.), Relating events in narrative: Typological and contextual perspectives (219–257). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar logo with link to Google Scholar
Stam, G. 2006. Thinking for speaking about motion: L1 and L2 speech and gesture. IRAL 44(2), 143–169. Google Scholar logo with link to Google Scholar
Stefanowitsch, A. 2009. Bedeutung und Gebrauch in der Konstruktionsgrammatik. Zeitschrift für germanistische Linguistik, 21, 565–592.Google Scholar logo with link to Google Scholar
Steen, F., & Turner, M. 2013. Multimodal Construction Grammar. In M. Borkent, Dancygier, B., & Hinnell, J. (Eds.), Language and the creative mind. Stanford, CA: CSLI Publications.Google Scholar logo with link to Google Scholar
Sweester, E. 2006. Looking at space to study mental spaces: Co-speech gesture as a crucial data source in cognitive linguistics. In M. Gonzalez-Marquez, Mittelberg, I., Coulson, S., & M. Spivey (Eds.), Methods in Cognitive Linguistics (203–226). Amsterdam & Philadelphia: John Benjamins.Google Scholar logo with link to Google Scholar
Talmy, L. 1985. Lexicalization patterns: Semantic structure in lexical forms. In T. Shopen, (Ed.), Language typology and semantic description. Vol. 3: Grammatical categories and the lexicon (36–149). Cambridge: Cambridge University Press.Google Scholar logo with link to Google Scholar
2000. Toward a cognitive semantics. Cambridge, MA, MIT Press.Google Scholar logo with link to Google Scholar
Traugott, E., & Trousdaele, G. 2013. Constructionalization and constructional changes. Oxford: Oxford University Press. Google Scholar logo with link to Google Scholar
Tomasello, M. 2008. Origins of human communication. MIT Press.Google Scholar logo with link to Google Scholar
Wittenburg, P., Brugman, H., Russel, A., Klassmann, A., & Sloetjes, H. 2006. Elan: a professional framework for multimodality research. Proceedings of Language Resources and Evaluation Conference (LREC).Google Scholar logo with link to Google Scholar
Zima, E. 2014a. English multimodal motion constructions. A construction grammar perspective. Studies van de BKL – Travaux du CBL – Papers of the LSB, Volume 8. [URL]
2014b. Gibt es multimodale Konstruktionen? Eine Studie zu [V(motion) in circles] und [all the way from X PREP Y]. Gesprächsforschung – Online-Zeitschrift zur verbalen Interaktion, 15, 1–48.Google Scholar logo with link to Google Scholar
in press. On the multimodality of [all the way from X PREP Y]. Linguistic Vanguard.
Zima, E., Bergs, Al. (Eds.). In press. Multimodality and Construction Grammar. Special issue of Linguistic Vanguard.
Cited by (11)

Cited by 11 other publications

Lehmann, Claudia
2025. Oh, multimodality where art thou?. Constructions and Frames DOI logo
Lehmann, Claudia
2025. Towards a functional perspective on multimodal constructions. In Multimodal Communication from a Construction Grammar Perspective [Constructional Approaches to Language, 38], ► pp. 220 ff. DOI logo
Zima, Elisabeth
2025. Construction Grammar and Gesture. In The Cambridge Handbook of Construction Grammar, ► pp. 384 ff. DOI logo
Zima, Elisabeth
2025. Multimodal Construction Grammar, DOI logo
Pleyer, Michael, Ryan Lepic & Stefan Hartmann
2024. Compositionality in Different Modalities: A View from Usage-Based Linguistics. International Journal of Primatology 45:3 ► pp. 670 ff. DOI logo
Dressel, Dennis, Philipp Dankel & Alexander M. Teixeira Kalkhoff
2023. What can collaboratively produced lists tell us about constructions?. In Constructions in Spanish [Constructional Approaches to Language, 34], ► pp. 340 ff. DOI logo
Hart, Christopher & Bodo Winter
2022. Gesture and legitimation in the anti-immigration discourse of Nigel Farage. Discourse & Society 33:1 ► pp. 34 ff. DOI logo
Rice, Alexander
2022. A recurring absence gesture in Northern Pastaza Kichwa. Gesture 21:1 ► pp. 28 ff. DOI logo
Turner, Mark
2022. Multimodal body, multimodal mind, multimodal communication. In Dynamism in Metaphor and Beyond [Metaphor in Language, Cognition, and Communication, 9], ► pp. 95 ff. DOI logo
Hart, Christopher & Javier Marmol Queralto
2021. What can cognitive linguistics tell us about language-image relations? A multidimensional approach to intersemiotic convergence in multimodal texts. Cognitive Linguistics 32:4 ► pp. 529 ff. DOI logo
Steen, Francis F., Anders Hougaard, Jungseock Joo, Inés Olza, Cristóbal Pagán Cánovas, Anna Pleshakova, Soumya Ray, Peter Uhrig, Javier Valenzuela, Jacek Woźny & Mark Turner
2018. Toward an infrastructure for data-driven multimodal communication research. Linguistics Vanguard 4:1 DOI logo

This list is based on CrossRef data as of 10 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue