Article published In: Interaction Studies
Vol. 17:1 (2016) ► pp.128–153
Language-at all times
Action and interaction as contexts for enriching representations
Published online: 7 October 2016
https://doi.org/10.1075/is.17.1.06nom
https://doi.org/10.1075/is.17.1.06nom
Abstract
This article discusses the importance of social interaction for the development of the representations for symbolic communication. We suggest that there is no need to distinguish between different representational systems emerging at different stages of development. Instead, we propose that representations are rich right from the beginning of a child’s life, and that they are driven mainly by acting and interacting in the physical and social world. The more variety in a child’s interactional experience (i.e., synchrony, sequentiality, and prediction), the more enriched and abstracted the representations become. We review literature providing evidence for the ways in which infants’ development toward symbolic communication benefits from repeated social (inter)action and consider some implications for computational approaches.
Article outline
- 1.Introduction
- 2.Current views on cognitive development
- 3.Nature of early representations
- 4.What do we miss in language acquisition models?
- 5.Toward rich representations: linking embodiment and social interaction
- 5.1Intermodal synchrony: Embodiment
- 5.2Interpersonal synchrony and alignment: Mirroring and contingency
- 5.3Establishing rules of exchange: Conventionalized sequential organization
- 5.4Predictability as an underlying mechanism
- 6.Conclusions
- Acknowledgements
References
References (115)
Akhtar, N., & Tomasello, M. (2000). The social nature of words and word learning. In R. M. Golinkoff & K. Hirsh-Pasek (Eds.), Becoming a word learner: A debate on lexical acquisition (pp. 115–135). Oxford, England: Oxford University Press.
Ambrosini, E., Reddy, V., de Looper, A., Costantini, M., Lopez, B., Sinigaglia, C., & Lappe, M. (2013). Looking ahead: Anticipatory gaze and motor ability in infancy. PLoS ONE, 8(7), 1–9.
Anderson, M.L. (2010). Neural reuse: A fundamental organizational principle of the brain. Behavioral and Brain Sciences, 331, 254–313.
Bahrick, L. E., & Lickliter, R. (2000). Intersensory redundancy guides attentional selectivity and perceptual learning in infancy. Developmental Psychology, 36(2), 190–201
Bahrick, L. E., Lickliter, R., & Flom, R. (2004). Intersensory redundancy guides the development of selective attention, perception, and cognition in infancy. Current Directions in Psychological Science, 13(3), 99–102.
Balaban, M. T., & Waxman, S. R. (1997). Do words facilitate object categorization in 9-month-old infants? Journal of Experimental Child Psychology, 64(1), 3–26.
Barsalou, L. W., Santos, A., Simmons, W. K., & Wilson, C. D. (2008). Symbols, embodiment, and meaning. In M. D. Vega, Glenberg, A. M., & A. C. Graesser (Eds.), Symbols, embodiment, and meaning (pp. 245–283). Oxford, England: Oxford University Press.
Beebe, B., Gerstman, L., Carson, B., Dolins, M., Zigman, A., Rosensweig, H.,... Korman, M. (1982). Rhythmic communication in the mother–infant dyad. In M. Davis (Ed.), Interaction rhythms: Periodicity in communicative behavior (pp. 77–100). New York, NY: Human Sciences Press.
Bergelson, E., & Swingley, D. (2012). At 6–9 months, human infants know the meanings of many common nouns. Proceedings of the National Academy of Sciences, 109(9), 3253–3258.
Bortfeld, H., Morgan, J. L., Golinkoff, R. M., & Rathbun, K. (2005). Mommy and me: Familiar names help launch babies into speech-stream segmentation. Psychological Science, 16(4), 298–304.
Bowerman, M. (1996). Learning how to structure space for language: A crosslinguistic perspective. In P. Bloom, Peterson, M., Nadel, L. & M. Garrett (Eds.), Language and space. (pp. 385–436). Cambridge MA: MIT Press.
Brand, R. J., & Tapscott, S. (2007). Acoustic packaging of action sequences by infants. Infancy, 11(3), 321–332.
Bruner, J. S., & Sherwood, V. (1976). Peekaboo and the learning of rule structures. In J. S. Bruner (Ed.), Play: Its role in development and evolution (pp. 277–285. Harmondsworth, England: Penguin.
Buccino, G., Riggio, L., Melli, G., Binkofski, F., Gallese, V., & Rizzolatti, G. (2005). Listening to action-related sentences modulates the activity of the motor system: A combined TMS and behavioral study. Cognitive Brain Research, 24(3), 355–363.
Cangelosi, A., Metta, G., Sagerer, G., Nolfi, S., Nehaniv, C., Fischer, K., & Zeschel, A. et al.. (2010). Integration of action and language knowledge: A roadmap for developmental robotics. IEEE Transactions on Autonomous Mental Development, 2(3), 167–195.
Cekaite, A. (2016). Touch as social control: Haptic organization of attention in adult-child interactions. Journal of Pragmatics, 921, 30–42.
Choi, S. (2000). Caregiver input in English and Korean: Use of nouns and verbs in book reading and toy-play contexts. Journal of Child Language, 271, 69–96.
Choi, S., McDonough, L., Bowerman, M., & Mandler, J. M. (1999). Early sensitivity to language-specific spatial categories in English and Korean. Cognitive Development, 141, 241–268.
Clark, A. (2013). Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behavioral and Brain Sciences, 36(3), 181–204.
Colombo, J., & Bundy, R. S. (1983). Infant response to auditory familiarity and novelty. Infant Behavior and Development, 6(2), 305–311.
de Barbaro, K., Johnson, C. M., Forster, D., & Deák, G. O. (2015). Sensorimotor decoupling contributes to triadic attention: A longitudinal investigation of mother–infant–object interactions. Child Development.
de León, L. (2000). The emergent participant: Interactive patterns in the socialization of Tzotzil (Mayan) infants. Journal of Linguistic Anthropology, 81, 131–161.
Fantasia, V., Fasulo, A., Costall, A., & López, B. (2014). Changing the game: Exploring infants’ participation in early play routines. Frontiers in Psychology, 51, 1–9.
Feldman, J., & Narayanan, S. (2004). Embodied meaning in a neural theory of language. Brain and Language, 89(2), 385–392.
Ferguson, B., & Waxman, S. R. (2016). What the [beep]? Six-month-olds link novel communicative signals to meaning. Cognition, 1461, 185–189.
Ferrier, L. (1978). Some observations of error in context. In N. Waterson & C. Snow (Eds.), The development of communication (pp. 301–309). London, England: Wiley.
Ferry, A. L., Hespos, S. J., & Waxman, S. R. (2010). Categorization in 3-and 4-month-old infants: An advantage of words over tones. Child Development, 81(2), 472–479.
Fischer, M. H., & Zwaan, R. A. (2008). Embodied language: A review of the role of the motor system in language comprehension. Quarterly Journal of Experimental Psychology, 61(6), 825–850.
Friedman, O., & Leslie, A. M. (2007). The conceptual underpinnings of pretense: Pretending is not “behaving-as-if.” Cognition, 105(1), 103–124.
Gallese, V., & Lakoff, G. (2005). The brain’s concepts: The role of the sensory-motor system in reason and language. Cognitive Neuropsychology, 221, 455–479.
Gampe, A., & Daum, M. M. (2014). Productive verbs facilitate action prediction in toddlers. Infancy, 19(3), 301–325.
Gerson, S. A., & Woodward, A. L. (2014). Learning from their own actions: The unique effect of producing actions on infants’ action understanding. Child Development, 85(1), 264–277.
Gilbert, D. T., & Wilson, T. D. (2007). Prospection: Experiencing the future. Science, 3171, 1351–1354.
Gleason, J. B., Perlmann, R. Y., & Greif, E. B. (1984). What’s the magic word: Learning language through politeness routines. Discourse Processes, 7(4), 493–502.
Gleason, J. B., & Weintraub, S. (1976). The acquisition of routines in child language. Language in Society, 5(2), 129–136.
Glenberg, A. M., & Kaschak, M. P. (2002). Grounding language in action. Psychonomic Bulletin & Review, 91, 558–565.
Göksun, T., Hirsh-Pasek, K., & Golinkoff, R. M. (2010). Trading spaces carving up events for learning language. Perspectives on Psychological Science, 5(1), 33–42.
Golinkoff, R. M., & Hirsh-Pasek, K. (2006). Baby wordsmith from associationist to social sophisticate. Current Directions in Psychological Science, 15(1), 30–33
Harris, P. L., & Kavanough, R. D. (1993). Young children’s understanding of pretense. Monographs of the Society for Research in Child Development, 58(1), 1–91.
Harrist, A. W., & Waugh, R. M. (2002). Dyadic synchrony: Its structure and function in children’s development. Developmental Review, 22(4), 555–592.
Heller, V., & Rohlfing, K. J. (2015). From establishing reference to representing events independent from the here and now: A longitudinal study of depictive practices in early childhood. GESPIN Gesture and Speech in Interaction proceedings, Nantes 2–4 September 2015, 143–148.
Hirsh-Pasek, K., Adamson, L. B., Bakeman, R., Owen, M. T., Golinkoff, R. M., Pace, A.,... Suma, K. (2015). The contribution of early communication quality to low-income children’s language success. Psychological Science, 26(7), 1071–1083.
Hirsh-Pasek, K., & Golinkoff, R. M. (1996). The origins of grammar: Evidence from early language comprehension. Cambridge, MA: MIT Press.
Hsu, H. C., & Fogel, A. (2003). Stability and transitions in mother-infant face-to-face communication during the first 6 months: A microhistorical approach. Developmental Psychology, 39(6), 1061–1082.
Iverson, J. M., & Thelen, E. (1999). Hand, mouth and brain. The dynamic emergence of speech and gesture. Journal of Consciousness Studies, 6(11–12), 19–40.
Jaffe, F., Beebe, B., Feldstein, S., Crown, C. L., & Jasnow, M. D. (2001). Rhythms of dialogue in infancy. Monographs of the Society for Research in Child Development, 66(2, Serial No. 265).
Jeannerod, M. (2006). Motor cognition – what action tells the self. Oxford, England: Oxford University Press.
Johnston, J. R., & Slobin, D. I. (1979). The development of locative expressions in English, Italian, Serbo-Croatian and Turkish. Journal of Child Language, 61, 529–545.
Karasik, L. B., Tamis‐LeMonda, C. S., & Adolph, K.E. (2014). Crawling and walking infants elicit different verbal responses from mothers. Developmental science, 17(3), 388–395.
Kaye, K., & Wells, A. J. (1980). Mothers’ jiggling and the burst-pause pattern in neonatal feeding. Infant Behavior and Development, 31, 29–46.
Lakoff, G. (1987). Women, fire, and dangerous things: What categories reveal about the mind. Chicago, IL: University of Chicago Press.
Leimbrink, K. (2010). Kommunikation von Anfang an: Die Entwicklung von Sprache in den ersten Lebensmonaten [Communication right from the start: Language development in the first months of life]. Tübingen, Germany: Stauffenburg.
Lerner, G., Zimmerman, D. H., & Kidwell, M. (2011). Formal structures of practical tasks: A resource for action in the social life of very young children. In J. Streeck, Goodwin, C., & C. D. LeBaron (Eds.), Embodied interaction. Language and body in the material world (pp. 44–58). Cambridge, England: Cambridge University Press.
Lewkowicz, D. (2000). The development of intersensory temporal perception: An epigenetic systems/limitations view. Psychological Bulletin, 126(2), 281.
Liszkowski, U. (2014). Two sources of meaning in infant communication: Preceding action contexts and act-accompanying characteristics. Philosophical Transactions of the Royal Society B: Biological Sciences, 369 (1651), 20130294.
Madole, K. L., & Oakes, L. M. (1999). Making sense of infant categorization: Stable processes and changing representations. Developmental Review, 191, 263–296.
Mandler, J.M. (1998). Representation. In D. Kuhn & R. Siegler (Eds.), Cognition, perception, and language (pp. 255–308). Volume 21 of W. Damon (Series Ed.), Handbook of child psychology. New York, NY: Wiley.
(2012). On the spatial foundations of the conceptual system and its enrichment. Cognitive Science, 36(3), 421–451.
Marentette, P, Nicoladis, E. (2012) Does ontogenetic ritualization explain early communicative gestures in human infants? In S. Pika & Liebal, K (Eds.), Developments in primate gesture research (pp. 33–54). Amsterdam, The Netherlands: John Benjamins.
McDonough, L., Choi, S., & Mandler, J. (2003). Understanding spatial relations: Flexible infants, lexical adults. Cognitive Psychology, 461, 229–259.
Nomikou, I. (2015). The collaborative construction of early multimodal input and its significance for language development (Doctoral thesis, Bielefeld University, Germany).
Nomikou, I., & Rohlfing, K. J. (2011). Language does something: Body action and language in maternal input to three-month-olds. IEEE Transactions on Autonomous Mental Development, 3(2), 113–128.
Nomikou, I., Rohlfing, K. J., Mandler, J. M. & Cimiano, P. (submitted). Evidence for early comprehension of action verbs.
Nelson, K. (1974). Concept, word, and sentence: interrelations in acquisition and development. Psychol. Rev. 811, 267–285.
Nomikou, I., Rohlfing, K. J., & Szufnarowska, J. (2013). Educating attention: Recruiting, maintaining, and framing eye contact in early natural mother–infant interactions. Interaction Studies, 14(2), 240–267.
Nomikou, I., Leonardi, G., Rohlfing, K. J. & Rączaszek-Leonardi, J. (2016). Constructing interaction: the development of gaze dynamics. Infant and Child Development, 25(3), (277–295).
Papoušek, M., & Papoušek, H. (1989). Forms and functions of vocal matching in interactions between mothers and their precanonical infants. First Language, 9(6), 137–157.
(1990). Excessive infant crying and intuitive parental care: Buffering support and its failures in parent-infant interaction. Early Child Development and Care, 65(1), 117–126.
Papoušek, M., Papoušek, H., & Harris, B. J. (1987). The emergence of play in parent-infant interactions. In D. Görlitz & J. F. Wohlwill (Eds.) Curiosity, imagination, and play: On the development of spontaneous cognitive and motivational processes (pp. 214–246). Hillsdale, NJ: Erlbaum.
Parise, E., & Csibra, G. (2012). Electrophysiological evidence for the understanding of maternal speech by 9-month-old infants. Psychological Science, 231, 128–733.
Pauen, S., Birgit, T., Hoehl, S., & Bechtel, S. (2015). Show me the world: Object categorization and socially guided object learning in infancy. Child Development Perspectives, 9(2), 111–116.
Peters, A. M. & Boggs, S. T. (1986). Interactional routines as cultural influences upon language acquisition. In B. B. Schieffelin & E. Ochs (Eds.), Language socialization across cultures (pp. 80–96). Cambridge, England: Cambridge University Press.
Pezzulo, G., Barsalou, L. W., Cangelosi, A., Fischer, M. H., McRae, K., & Spivey, M. J. (2012). Computational grounded cognition: A new alliance between grounded cognition and computational modeling. Frontiers in Psychology, 31
Piaget, J. (1954). The construction of reality in the child (M. Cook, Trans.). New York, NY: Basic Books. (Original work published 1937)
Piaget, J., & Inhelder, B. (1993). Die Entwicklung des räumlichen Denkens beim Kinde [The child’s conception of space]. Stuttgart, Germany: Klett-Cotta.
Plunkett, K., Hu, J. F., & Cohen, L. B. (2008). Labels can override perceptual categories in early infancy. Cognition, 106(2), 665–681.
Pruden, S. M., Hirsh-Pasek, K., Golinkoff, R. M., & Hennon, E. A. (2006). The birth of words: Ten-month-olds learn words through perceptual salience. Child Development, 77(2), 266–280.
Pulvermüller, F. (2005). Brain mechanisms linking language and action. Nature Reviews Neuroscience, 6(7), 576–582.
Rączaszek-Leonardi, J., Nomikou, I., & Rohlfing, K. J. (2013). Young children’s dialogical actions: The beginnings of purposeful intersubjectivity. IEEE Transactions on Autonomous Mental Development, 5(3), 210–221.
Rakoczy, H., & Tomasello, M. (2006). Two-year-olds grasp the intentional structure of pretense acts. Developmental Science, 9(6), 557–564.
Ratner, N., & Bruner, J. S. (1978). Games, social exchange and the acquisition of language. Journal of Child Language, 51, 391–401.
Reddy, V., Markova, G., & Wallot, S. (2013). Anticipatory adjustments to being picked up in infancy. Plo S one, 8(6), e65289.
Reddy, V., & Uithol, S. (2015). Engagement: looking beyond the mirror to understand action understanding. British Journal of Developmental Psychology, 34(1), 101–114.
Rohlfing, K. J., Wrede, B., Vollmer, A.-L., Oudeyer, P.-Y. (2016). An alternative to mapping a word onto a concept in language acquisition: Pragmatic frames. Frontiers in Psychology, 71.
Rossmanith, N., Costall, A., Reichelt, A. F., López, B., & Reddy, V. (2014). Jointly structuring triadic spaces of meaning and action: book sharing from 3 months on. Frontiers in Psychology, 51.
Sadoski, M. & Paivio, A. (2004). A dual coding theoretical model of reading. In R. B. Ruddell & N. J. Unrau (Eds.), Theoretical models and processes of reading (pp. 1329–1362). Newark, DE: International Reading Association.
Schilling, M., & Narayanan, S. (2013), Communicating with executable action representations. In Proceedings of AAAI Spring Symposium Series 2013, Stanford, CA. [URL]
Slater, A., Quinn, P., Kelly, D., Lee, K., Longmore, C., McDonald, P., & Pascalis, O. (2010). The shaping of the face space in early infancy: Becoming a native face processor. Child Development Perspectives, 41, 205–211.
Sobel, D.M. (2007). Children’s knowledge of the relation between intentional action and pretending. Cognitive Development, 22(1), 130–141.
Spranger, M., & Steels, L. (2014). Discovering communication through ontogenetic ritualization. In Development and Learning and Epigenetic Robotics (ICDL-Epirob), 2014 Joint IEEE International Conferences on (pp. 14–19). IEEE.
Stern, D.N. (1974). Mother and infant at play: The dyadic interaction involving facial, vocal, and gaze behaviors. In M. Lewis &. L. A. Rosenblum (Eds.), The effect of the infant on its caregiver (pp. 187–213). Oxford, England: Wiley-Interscience.
(1985). The interpersonal world of the infant: A view from psychoanalysis and developmental psychology. New York, NY: Basic Books.
Strähle, P. (2013). Emergenz globaler Diskursfähigkeiten im Rahmen von Begrüßungsroutinen: Rekonstruktion interaktiver Erwerbsprozesse [Emergence of global discourse abilities in greeting routines: Reconstruction of interactive acquisition processes] (Doctoral thesis, Technische Universität Dortmund, Germany). Retrieved from [URL]
Takada, A. (2005). Early vocal communication and social institution: Appellation and infant verse addressing among the Central Kalahari San. Crossroads of Language, Interaction, and Culture, 61, 80–108.
Tarplee, C. (2010). Next turn and intersubjectivity in children’s language acquisition. In H. Gardner & M. A. Forrester (Eds.), Analysing interactions in childhood. Insights from conversation analysis (pp. 3–22). Chichester, England: Wiley-Blackwell.
Thelen, E., & Smith, L. B. (1994). A dynamic systems approach to the development of cognition and action. Cambridge, MA: MIT Press.
Tomasello, M. (2003). Constructing a language. A usage-based theory of language acquisition. Cambridge, MA: Harvard University Press.
Trevarthen, C. (1979). Communication and cooperation in early infancy: A description of primary intersubjectivity. In M. Bullowa (Ed.), Before speech. The beginning of interpersonal communication (pp. 321–347). Cambridge, England: Cambridge University Press.
Tulbert, E., & Goodwin, M. H. (2011). Choreographies of attention: Multimodality in a routine family activity. In J. Streeck, Goodwin, C., & C. D. LeBaron (Eds.), Embodied interaction: Language and body in the material world (pp. 79–92). Cambridge, England: Cambridge University Press.
Wagner, L., & Lakusta, L. (2009). Using language to navigate the infant mind. Perspectives on Psychological Science, 4(2), 177–184.
Warlaumont, A. S., Richards, J. A., Gilkerson, J., & Oller, D. K. (2014). A social feedback loop for speech development and its reduction in autism. Psychological science, 25(7). 1314–1324.
Watson, J. (1985). Contingency perception in early social development. In T. Field & N. A. Fox (Eds.), Social perception in infants (pp. 157–176). Norwood, NJ: Ablex.
Wellsby, M., & Pexman, P. M. (2014). Developing embodied cognition: Insights from children’s concepts and language processing. Frontiers in Psychology, 51, 506.
Cited by (14)
Cited by 14 other publications
Matsuda, Yui, Harry Weger & Anne E. Norris
Wildt, Eugenia & Katharina J. Rohlfing
Bazhydai, Marina, Han Ke, Hannah Thomas, Malcolm K. Y. Wong & Gert Westermann
Delgrange, Clement, Jean-Michel Dussoux & Peter Ford Dominey
Elmlinger, Steven L., Sumarga H. Suanda, Linda B. Smith & Chen Yu
Nomikou, Iris, Katharina J. Rohlfing, Philipp Cimiano & Jean M. Mandler
Wildt, Eugenia, Katharina J. Rohlfing & Ingrid Scharlau
Bläsing, Bettina E., Jenny Coogan, José Biondi & Thomas Schack
Bläsing, Bettina E. & Odile Sauzet
Maffongelli, Laura, Katharina Antognini & Moritz M. Daum
Fasulo, Alessandra, Janhavi Shukla & Stephanie Bennett
Mealier, Anne-Laure, Gregoire Pointeau, Solène Mirliaz, Kenji Ogawa, Mark Finlayson & Peter F. Dominey
Nomikou, Iris, Giuseppe Leonardi, Alicja Radkowska, Joanna Rączaszek-Leonardi & Katharina J. Rohlfing
This list is based on CrossRef data as of 16 march 2026. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.
