Cover not available

Article published In: Gesture
Vol. 18:1 (2019) ► pp.57–82

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
authorization required

Dynamic processes of intermodal coordination in the ontogenesis of language

 | University of the Basque Country
 | University of the Basque Country
 | University of the Basque Country
 | University of the Basque Country
Published online: 11 September 2020
DOI logo with link
https://doi.org/10.1075/gest.00033.rom
Abstract
The aim of this study is to explore the multimodal communicative patterns used by infants during their first-words transition period. The combinatorial patterns of twelve children living in Basque Country with different mother tongues were analyzed longitudinally from 9 to 21 months of age. A total of 4,299 communicative behaviors were recorded and coded (vocalizations, gestures, and pragmatic functions). Results showed a significant increase in multimodal communicative patterns from 12 months onwards, and differences in the infants’ vocal construction depending on the specific types of gestures involved. Thus, it was observed that gestures and speech combinations have influence on the child’s pragmatic function and vocalizations structure.
Article outline
  • Introduction
  • Method
    • Participants
    • Materials and procedure
    • Coding and reliability
  • Results
  • Discussion and conclusions
  • Acknowledgements
  • References
References (82)
References
Acredolo, Linda & Susan Goodwin (1988). Symbolic gesturing in normal infants. Child Development, 59 (2), 450–466. Google Scholar logo with link to Google Scholar
Alibali, Martha W., Sotaro Kita, & Amanda J. Young (2000). Gesture and the process of speech production: We think, therefore we gesture. Language and Cognitive Processes, 15 (6), 593–613. Google Scholar logo with link to Google Scholar
Aureli, Tiziana, Maria Spinelli, Mirco Fasolo, Maria Concetta Garito, Paola Perucchini, & Laura D’Odorico (2017). The pointing-vocal coupling progression in the first half of the second year of life. Infancy, 22 (6), 801–818. Google Scholar logo with link to Google Scholar
Bates, Elizabeth, Luigia Camaioni, & Virginia Volterra (1975). The acquisition of performatives prior to speech. Merrill-Palmer Quarterly of Behavior and Development, 21 (3), 205–224.Google Scholar logo with link to Google Scholar
Bates, Elizabeth, Laura Benigni, Inge Bretherton, Luigia Camaioni, & Virginia Volterra (1979). The emergence of symbols: Cognition and communication in infancy. New York: Academic Press.Google Scholar logo with link to Google Scholar
Bergmann, Kirsten, Volkan Aksu, & Stefan Kopp (2011). The relation of speech and gestures: Temporal synchrony follows semantic synchrony. Proceedings of the 2nd Workshop on Gesture and Speech in Interaction (GeSpIn 2011). Bielefeld, Germany.Google Scholar logo with link to Google Scholar
Blake, Joanna, Paula O’Rourke, & Grace Borzellino (1994). Form and function in the development of pointing and reaching gestures. Infant Behavior & Development, 17 (2), 195–203. Google Scholar logo with link to Google Scholar
Bosch, Laura (2004).Evaluación fonológica del habla infantil. Barcelona: Masson.Google Scholar logo with link to Google Scholar
Butcher, Cynthia & Susan Goldin-Meadow (2000). Gesture and the transition from one- to two-word speech: when hand and mouth come together. In David McNeill (Ed.), Language and gesture (pp. 235–258). Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Cadime, Irene, Carla Silva, Sandra Santos, Iolanda Ribeiro, & Fernanda Leopoldina Viana (2017). The interrelatedness between infants’ communicative gestures and lexicon size: A longitudinal study. Infant Behavior and Development, 481, 88–97. Google Scholar logo with link to Google Scholar
Capirci, Olga, Jana M. Iverson, Elena Pizzuto, & Virginia Volterra (1996). Gestures and words during the transition to two-word speech. Journal of Child Language, 23 (3), 645–673. Google Scholar logo with link to Google Scholar
Capone, Nina C. & Karla K. McGregor (2004). Gesture development: a review for clinicians and researchers. Journal of Speech, Language, and Hearing Research, 47 (1), 173–186. Google Scholar logo with link to Google Scholar
Carpenter, Malinda, Katherine Nagell, Michael Tomasello, George Butterworth, & Chris Moore (1998). Social cognition, joint attention, and communicative competence from 9 to 15 months of age. Monographs of the Society for Research in Child Development, 63 (4), 152–174. Google Scholar logo with link to Google Scholar
Caselli, Maria Cristina, Pasquale Rinaldi, Silvia Stefanini, & Virginia Volterra (2012). Early action and gesture ‘vocabulary’ and its relation with word comprehension and production. Child Development, 83 (2), 526–542. Google Scholar logo with link to Google Scholar
Church, Ruth Breckinridge, Martha W. Alibali, & Spencer D. Kelly (2017). Why gesture? How the hands function in speaking, thinking and communicating. Amsterdam & Philadelphia: John Benjamins Publishing Company. Google Scholar logo with link to Google Scholar
Colonnesi, Cristina, Geert Jan J. Stams, Irene Koster, & Marc J. Noom (2010). The relation between pointing and language development: A meta-analysis. Developmental Review, 30 (4), 352–366. Google Scholar logo with link to Google Scholar
De Ruiter, Jan-Peter (1998). Gesture and speech production. Doctoral dissertation, Nijmegen: Katholieke Universiteit.Google Scholar logo with link to Google Scholar
(2000). The production of gesture and speech. In David McNeill (Ed.), Language and gesture (pp. 284–311). Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Ejiri, Keiko & Nobuo Masataka (2001). Co-occurrence of preverbal vocal behavior and motor action in early infancy. Developmental Science, 4 (1), 40–48. Google Scholar logo with link to Google Scholar
Esteve-Gibert, Núria & Pilar Prieto (2013). Intonational and gestural structures are temporally coordinated. Laboratory Phonology (LabPhon 13). Google Scholar logo with link to Google Scholar
(2014). Infants temporally coordinate gesture-speech combinations before they produce their first words. Speech Communication, 571, 301–316. Google Scholar logo with link to Google Scholar
Esteve-Gibert, Núria, Pilar Prieto, & Ferran Pons (2015). Nine-month-old infants are sensitive to the temporal alignment of prosodic and gesture prominences. Infant Behavior and Development, 381, 126–129. Google Scholar logo with link to Google Scholar
Ezeizabarrena, Maria Jose (2002). Root infinitives in two pro-drop languages. In Ana Teresa Pérez-Leroux & Juana Muñoz Liceras (Eds.), The acquisition of Spanish morphosyntax (pp. 35–65). Dordrecht: Kluwer. Google Scholar logo with link to Google Scholar
Feldman, Ruth & J. Steven Reznick (1996). Maternal perception of infant intentionality at 4 and 8 months. Infant Behavior and Development, 19 (4), 483–496. Google Scholar logo with link to Google Scholar
Fernández, Isabel (2009). ¿Cómo hablan los niños? El desarrollo del componente fonológico en el lenguaje infantil. Madrid: Arco/Libros.Google Scholar logo with link to Google Scholar
Goldin-Meadow, Susan, Whitney Goodrich, Eve Sauer, & Jana Iverson (2007). Young children use their hands to tell their mothers what to say. Developmental Science, 10 (6), 778–785. Google Scholar logo with link to Google Scholar
Goldstein, Brian A. & Karen E. Pollock (2000). Vowel errors in Spanish-speaking children with phonological disorders: a retrospective, comparative study. Clinical Linguistics and Phonetics, 141, 217–225. Google Scholar logo with link to Google Scholar
Goldstein, Michael H., Jennifer A. Schwade, & Marc H. Bornstein (2009). The value of vocalizing five-month-old infants associate their own noncry vocalizations with responses from caregivers. Child Development, 80 (3), 636–644. Google Scholar logo with link to Google Scholar
Grice, H. Paul (1975). Logic and conversation. In Peter Cole & Jerry L. Morgan (Eds.), Syntax and semantics, Vol. 3: Speech acts (pp. 41–58). New York: Academic Press.Google Scholar logo with link to Google Scholar
Idiazabal, Itziar (1991). Adquisición del lenguaje en niños bilingües y monolingües. Bilbao: UPV/EHU.Google Scholar logo with link to Google Scholar
Igualada, Alfonso, Laura Bosch, & Pilar Prieto (2015). Language development at 18 months is related to multimodal communicative strategies at 12 months. Infant Behavior and Development, 391, 42–52. Google Scholar logo with link to Google Scholar
Iverson, Jana M. (2010). Multimodality in infancy: vocal-motor and speech-gesture coordinations in typical and atypical development. Enfance, 2010 (3), 257–274. Google Scholar logo with link to Google Scholar
Iverson, Jana M., Olga Capirci, Virginia Volterra, & Susan Goldin-Meadow (2008). Learning to talk in a gesture-rich world: Early communication in Italian vs. American children. First Language, 28 (2), 164–181. Google Scholar logo with link to Google Scholar
Iverson, Jana M. & Susan Goldin-Meadow (2005). Gesture paves the way for language development. Psychological Science, 16 (5), 367–371. Google Scholar logo with link to Google Scholar
Iverson, Jana M., Heather L. Tencer, Jill Lany, & Susan Goldin-Meadow (2000). The relation between gesture and speech in congenitally blind and sighted language-learners. Journal of Nonverbal Behavior, 24 (2), 105–130. Google Scholar logo with link to Google Scholar
Karousou, Alexandra (2003). Análisis de las vocalizaciones tempranas: su patrón evolutivo y su función determinante en la emergencia de la palabra. Unpublished doctoral dissertation. Madrid: Universidad Complutense.Google Scholar logo with link to Google Scholar
Kendon, Adam (1993). Human gesture. In Kathleen R. Gibson, & Tim Ingold (Eds.), Tools, language, and cognition in human evolution (pp. 43–62). New York: Cambridge University Press.Google Scholar logo with link to Google Scholar
Keren-Portnoy, Tamar, Marinella Majorano, & Marilyn Vihman (2009). From phonetics to phonology: The emergence of first words in Italian. Journal of Child Language, 36 (2), 235–267. Google Scholar logo with link to Google Scholar
Krahmer, Emiel & Marc Swerts (2007). The effects of visual beats on prosodic prominence: acoustic analyses, auditory perception and visual perception. Journal of Memory and Language, 57 (3), 396–414. Google Scholar logo with link to Google Scholar
Larrañaga, Pilar & Pedro Guijarro-Fuentes (2012). Clitics in L1 bilingual acquisition. First language, 321, 151–175. Google Scholar logo with link to Google Scholar
Lausberg, Hedda & Han Sloetjes (2009). Coding gestural behavior with the NEUROGES-ELAN system. Behavior Research Methods, 41 (3), 841–849. Google Scholar logo with link to Google Scholar
Legerstee, Maria (1991). Changes in the quality of infant sounds as a function of social and nonsocial stimulation. First Language, 11 (33), 327–343. Google Scholar logo with link to Google Scholar
Leonard, Thomas & Fred Cummins (2010). The temporal relation between beat gestures and speech. Language and Cognitive Processes, 26 (10), 1295–1309. Google Scholar logo with link to Google Scholar
Liszkowski, Ulf & Michael Tomasello (2011). Individual differences in social, cognitive, and morphological aspects of infant pointing. Cognitive Development, 26 (1), 16–29. Google Scholar logo with link to Google Scholar
Lüke, Carina, Ute Ritterfeld, Angela Grimminger, Ulf Liszkowski, & Katharina J. Rohlfing (2017). Development of pointing gestures in children with typical and delayed language acquisition. Journal of Speech, Language, and Hearing Research, 601, 3185–3197. Google Scholar logo with link to Google Scholar
Masataka, Nobuo (1993). Effects of contingent and noncontingent maternal stimulation on the vocal behaviour of three- to four-month-old Japanese infants. Journal of Child Language, 20 (2), 303–312. Google Scholar logo with link to Google Scholar
(1995). The relation between index-finger extension and the acoustic quality of cooing in three-month-old infants. Journal of Child Language, 22 (2), 247–257. Google Scholar logo with link to Google Scholar
McNeill, David (1992). Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.Google Scholar logo with link to Google Scholar
Miller, Jennifer L. & Amanda K. Lossia (2013). Prelinguistic infants’ communicative system: Role of caregiver social feedback. First Language, 33 (5), 524–544. Google Scholar logo with link to Google Scholar
Moore, Chris & Barbara D’Entremont (2001). Developmental changes in pointing as a function of parent’s attentional focus. Journal of Cognition and Development, 21, 109–129. Google Scholar logo with link to Google Scholar
Mumford, Katherine H. & Sotaro Kita (2014). Children use gesture to interpret novel verb meanings. Child Development, 851, 1181–1189. Google Scholar logo with link to Google Scholar
(2013). Patrones comunicativos multimodales en la transición a las primeras palabras: cambios en la coordinación de gestos y vocalizaciones. Infancia y Aprendizaje: Journal for the Study of Education and Development, 36 (4), 473–487. Google Scholar logo with link to Google Scholar
Murillo, Eva & Almudena Capilla (2015). Properties of vocalization- and gesture-combinations in the transition to first words. Journal Child Language, 41, 1–24. Google Scholar logo with link to Google Scholar
Oller, D. Kimbrough, Leslie A. Wieman, William J. Doyle, & Carol Ross (1976). Infant babbling and speech. Journal of Child Language, 31, 1–11. Google Scholar logo with link to Google Scholar
Özçaliskan, Seyda, & Susan Goldin-Meadow (2005). Do parents lead their children by the hand? Journal of child language, 32 (3), 481–505. Google Scholar logo with link to Google Scholar
Papaeliou, Christina & Colwyn Trevarthen (2006). Prelinguistic pitch patterns expressing ‘communication’ and ‘apprehension’. Journal of Child Language, 3 (3), 163–178. Google Scholar logo with link to Google Scholar
Rivero, Magda (2003). Los inicios de la comunicación: la intencionalidad comunicativa y el significado como procesos graduales. Anuario de Psicología, 34 (3), 337–356.Google Scholar logo with link to Google Scholar
Rochat, Phililppe (2007). Intentional action arises from early reciprocal exchanges. Acta Psychologica, 124 (1), 8–25. Google Scholar logo with link to Google Scholar
Romero, Asier, Aintzane Etxebarria, Iñaki Gaminde, & Urtza Garay (2015). El papel de la prosodia en la enseñanza de la L1. Un aporte didáctico para el aula de Educación Infantil y de Educación Primaria. Revista Phonica, 111, 64–86.Google Scholar logo with link to Google Scholar
Romero, Asier (2017). La vibrante en el País Vasco: adquisición fonológica y caracterización acústica desde el español y desde el euskera. Verba, 441, 169–194. Google Scholar logo with link to Google Scholar
Romero, Asier, Aintzane Etxebarria, Irati De Pablo, & Ainara Romero (2017). The interrelation of gestures and vocalization in early communication functions: Evidence from Basque language. Signos. Estudios de Lingüística, 50 (93), 96–123. Google Scholar logo with link to Google Scholar
Romero, Asier, Irati De Pablo, Aintzane Etxebarria, & Ainara Romero (2018). Coordinación entre vocalizaciones, gestos y prosodia antes del inicio de la comunicación verbal: evidencias desde la lengua vasca. Infancia y Aprendizaje, 41 (2), 325–368. Google Scholar logo with link to Google Scholar
Roustan, Benjamin & Marion Dohen (2010). Co-production of contrastive prosodic focus and manual gestures: temporal coordination and effects on the acoustic and articulatory correlates of focus. In Proceedings of Speech Prosody 2010, Chicago. [URL]
Rowe, Meredith & Susan Goldin-Meadow (2009). Differences in early gesture explain SES disparities in child vocabulary size at school entry. Science, 323 (5916), 951–953. Google Scholar logo with link to Google Scholar
Sacks, Jacqueline (2005). Communication development in infancy. In Jean Berko Gleason (Ed.), The development of language (pp. 40–68). Boston, MA: Pearson.Google Scholar logo with link to Google Scholar
Sarriá, Encarnación (1991). Observación de la comunicación intencional preverbal: Un sistema de codificación basado en el concepto de la categoría natural. Psicotema, 31, 359–380.Google Scholar logo with link to Google Scholar
Shore, Cecilia, Elizabeth Bates, Inge Bretherton, Marjorie Beeghly, & Barbara O’Connell (1990). Vocal and gestural symbols: Similarities and differences from 13 to 28 months. In Virginia Volterra & Carol J. Erting (Eds.), From gesture to language in hearing and deaf children (pp. 211–236). New York: Springer-Verlag. Google Scholar logo with link to Google Scholar
Smith, Bruce L., Sharon Brown-Sweeney, & Carol Stoel-Gammon (1989). A quantitative analysis of reduplicated and variegated babbling. First Language, 9 (26), 175–189. Google Scholar logo with link to Google Scholar
Stewart, Jessica Rae (2016). The use of gestures in typically developing children 9–15 months of age. Available from ProQuest Dissertations & Theses Global. Retrieved from [URL]
Tamarit, Javier (2001). Prueba ACACIA: Análisis de competencia comunicativa interactiva, autismo y otros transtornos. Madrid: EOS.Google Scholar logo with link to Google Scholar
Tomasello, Michael (1988). The role of joint attentional process in early language development. Language Sciences, 10 (1), 69–88. Google Scholar logo with link to Google Scholar
Tomasello, Michael, Malinda Carpenter, & Ulf Liszkowski (2007). A new look at infant pointing. Child Development, 78 (3), 705–722. Google Scholar logo with link to Google Scholar
Tomasello, Michael, & Michael Jeffrey Farrar (1986). Joint attention and early language. Child Development, 57 (6), 1454–1463. Google Scholar logo with link to Google Scholar
Vihman, Marilyn May & Ruth Miller (1988). Words and babble at the threshold of language acquisition. In Michael D. Smith & John L. Locke (Eds.), The emergent lexicon: The child’s development of a linguistic vocabulary (pp. 151–184). New York: Academic Press.Google Scholar logo with link to Google Scholar
Volterra, Virginia, Luigia Camaioni, Laura Benigni, & Elizabeth Bates (1981). Le prime parole. Giornale Italiano di Psicología, 81, 243–263.Google Scholar logo with link to Google Scholar
Wakefield, Elizabeth M., Miriam A. Novack, & Susan Goldin-Meadow (2017). Unpacking the ontogeny of gesture understanding: How movement becomes meaningful across development. Child Development, 89 (3), e245–e260. Google Scholar logo with link to Google Scholar
West, Brady T., Kathleen B. Welch, & Andrzej T. Galecki (2007). Linear mixed models: A practical guide using statistical software. New York: Chapman & Hall/CRC.Google Scholar logo with link to Google Scholar
Wu, Zhen & Julie Gros-Louis (2014). Infants’ prelinguistic communicative acts and maternal responses: Relations to linguistic development. First Language, 34 (1), 72–90. Google Scholar logo with link to Google Scholar
Cited by (1)

Cited by one other publication

Guevara, Irene & Cintia Rodríguez
2023. Developing communication through objects: Ostensive gestures as the first gestures in children's development. Developmental Review 68 ► pp. 101076 ff. DOI logo

This list is based on CrossRef data as of 9 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue