Article published In: How the Brain Got Language: Towards a New Road Map
Edited by Michael A. Arbib
[Interaction Studies 19:1/2] 2018
► pp. 22–37
Computational challenges of evolving the language-ready brain
2. Building towards neurolinguistics
Published online: 17 September 2018
https://doi.org/10.1075/is.17036.arb
https://doi.org/10.1075/is.17036.arb
Abstract
A theory of evolving the language-ready brain requires a theory of what it is that evolved. We offer the TCG (Template Construction Grammar) model of comprehension and production of utterances to exhibit hypotheses on how utterances may link to “what language is about.” A key subsystem of TCG is the SemRep system for semantic representation of a visual scene. We offer an account of how it may have evolved as an expansion of the ventral pathway supporting the planning of manual actions, complemented by a dorsal pathway for articulation. The Mirror System Hypothesis (MSH) claims that early Homo sapiens had protolanguage but not language and that cultural evolution yielded the social structures within which children could indeed acquire language. The article poses the challenge of understanding how a brain system could be innately specified that could develop into a TCG-like form, posing a range of questions for future research.
Article outline
- 1.Introduction
- 2.The Template Construction Grammar (TCG) model for how the human brain may support language production and comprehension
- 2.1Modeling using schema theory
- 2.2A model of language production for visual scene description
- 2.3A model of language comprehension for visual scene description
- 3.An evolutionary framework for language-ready pathways and processes
- 3.1SemRep in LCA-m
- 3.2SemRep in LCA-c
- 3.3SemRep in the language-ready brain
- 3.4Implications
- 4.Complex action recognition and imitation support the transition to language
- 5.Towards a new road map
- Acknowledgements
References
References (49)
Aboitiz, F. (2012). Gestures, vocalizations and memory in language origins. Frontiers in Evolutionary Neuroscience, 4(2). .
(2013). How did vocal behavior “take over” the gestural communication system? Language and Cognition, 51, 167–176.
Arbib, M. A. (2012). How the Brain Got Language: The Mirror System Hypothesis. New York & Oxford: Oxford University Press.
(2016). Towards a Computational Comparative Neuroprimatology: Framing the Language-Ready Brain. Physics of Life Reviews, 161, 1–54.
(2017). Dorsal and ventral streams in the evolution of the language-ready brain: Linking language to the world. Journal of Neurolinguistics, 431, Part B, 228–253. .
(2018). Computational challenges of evolving the language-ready brain: 1. From Manual Action to Protosign. Interaction Studies, 19(1–2), 7–21.
Arbib, M. A. & Bonaiuto, J. J. (eds) (2016). From Neuron to Cognition via Computational Neuroscience. Cambridge, MA: The MIT Press.
Arbib, M. A. & Caplan, D. (1979). Neurolinguistics must be Computational. Behavioral and Brain Sciences, 21, 449–483.
Arbib, M. A., Ganesh, V. & Gasser, B. (2014a). Dyadic Brain Modeling, Ontogenetic Ritualization of Gesture in Apes, and the Contributions of Primate Mirror Neuron Systems. Phil Trans Roy Soc B, 369 (1644), 20130414.
Arbib, M. A., Gasser, B. & Barrès, V. (2014b). Language is handy but is it embodied? Neuropsychologia, 551, 57–70.
Arbib, M. A. & Lee, J. Y. (2008). Describing visual scenes: Towards a neurolinguistics based on construction grammar. Brain Research, 12251, 146–162.
(2009). Template Construction Grammar and the Description of Visual Scenes. The Neurobiology of Language Conference, Chicago.
Arbib, M. A. & Liaw, J. -S. (1995). Sensorimotor Transformations in the Worlds of Frogs and Robots. Artificial Intelligence, 721, 53–79.
Barrès, V. & Arbib, M. A. (2018a). From Gaze Patterns to Utterances: Modeling the Dynamics of Visual Scene Description. Cognitive Science, In preparation.
(2018b). SALVIA: A Neuro-Cognitive Model of Normal and Agrammatic Language Comprehension. Brain and Language, In preparation.
Barrès, V. & Lee, J. Y. (2014). Template Construction Grammar: From Visual Scene Description to Language Comprehension and Agrammatism. Neuroinformatics, 12(1), 181–208.
Behrmann, M. & Plaut, D. C. (2013). Distributed circuits, not circumscribed centers, mediate visual recognition. Trends in Cognitive Sciences, 17(5), 210–219.
Berwick, R. C. & Chomsky, N. (2016). Why only us: Language and Evolution, Cambridge, MA: The MIT Press.
Bornkessel-Schlesewsky, I. & Schlesewsky, M. (2013). Reconciling time, space and function: A new dorsal–ventral stream model of sentence comprehension. Brain Lang, 125(1), 60–76.
Caramazza, A. & Zurif, E. B. (1976). Dissociation of algorithmic and heuristic processes in language comprehension: Evidence from aphasia. Brain and Language, 3(4), 572–582.
Chang, F. (2015). The role of learning in theories of English and Japanese sentence processing, in Nakyama, M. (ed), Handbook of Japanese psycholinguistics. Boston: De Gruyter Mouton, 353–385.
Colagé, I. (2016). The Cultural Evolution of Language and Brain: Comment on “Towards a computational comparative neuroprimatology: Framing the language-ready brain” by M.A. Arbib. Physics of Life Reviews, 161, 61–62.
Dehaene, S. & Cohen, L. (2011). The unique role of the visual word form area in reading. TRENDS in Cognitive Sciences, 15(6), 254–262.
Draper, B. A., Collins, R. T., Brolio, J., Hanson, A. R. & Riseman, E. M. (1989). The schema system. International Journal of Computer Vision, 21, 209–250.
Fagg, A. H. & Arbib, M. A. (1998). Modeling parietal-premotor interactions in primate control of grasping. Neural Netw, 11(7–8), 1277–1303.
Fogassi, L., Coudé, G. & Ferrari, P. F. (2013). The extended features of mirror neurons and the voluntary control of vocalization in the pathway to language. Language and Cognition, 51, 145–155.
Friederici, A. D. (2011). The brain basis of language processing: from structure to function. Physiological Reviews, 91(4), 1357–1392.
Hecht, E. E., Gutman, D. A., Bradley, B. A., Preuss, T. M. & Stout, D. (2015). Virtual dissection and comparative connectivity of the superior longitudinal fasciculus in chimpanzees and humans. Neuroimage, 1081, 124–137.
Hickok, G. & Poeppel, D. (2007). The cortical organization of speech processing. Nat Rev Neurosci, 8(5), 393–402.
Hill, J. C. (1983). A computational model of language acquisition in the two-year-old. Cognition and Brain Theory, 61, 287–317.
Kirby, S. (2000). Syntax without natural selection: How compositionality emerges from vocabulary in a population of learners, in Knight, C., Studdert-Kennedy, M. & Hurford, J. R. (eds), The evolutionary emergence of language. Cambridge: Cambridge University Press, 99–119.
Kirby, S., Cornish, H. & Smith, K. (2008). Cumulative cultural evolution in the laboratory: An experimental approach to the origins of structure in human language. Proceedings of the National Academy of Sciences, 105(31), 10681–10686.
MacWhinney, B. (1987). The Competition Model, in MacWhinney, B. (ed), Mechanisms of language acquisition. Hillsdale, NJ: Lawrence Erlbaum, 249–308.
(2005). A unified model of language development, in Kroll, J. F. & Groot, A. M. B. D. (eds), Handbook of bilingualism: Psycholinguistic approaches. Oxford: Oxford University Press, 49–67.
(2014). Item-based patterns in early syntactic development, in Herbst, T., Schmid, H. -J. & Faulhaber, S. (eds), Constructions Collocations Patterns Walter de Gruyter, 33–69.
Menenti, L., Gierhan, S. M. E., Segaert, K. & Hagoort, P. (2011). Shared Language Overlap and Segregation of the Neuronal Infrastructure for Speaking and Listening Revealed by Functional MRI. Psychological Science, 22(9), 1173–1182.
Myowa, M. (2018). The Evolutionary Roots of Human Imitation, Action Representation, and Word Learning Interaction Studies
, 19(1–2), 183–199.
Rilling, J. K., Glasser, M. F., Preuss, T. M., Ma, X., Zhao, T., Hu, X. & Behrens, T. E. (2008). The evolution of the arcuate fasciculus revealed with comparative DTI. Nature Neuroscience, 11(4), 426–428.
Sandler, W., Aronoff, M., Meir, I. & Padden, C. (2011). The gradual emergence of phonological form in a new language. Natural Language & Linguistic Theory. .
Segaert, K., Menenti, L., Weber, K., Petersson, K. M. & Hagoort, P. (2012). Shared Syntax in Language Production and Language Comprehension – An fMRI Study. Cerebral Cortex, 22(7), 1662–1670.
Cited by (5)
Cited by five other publications
Arbib, Michael A.
2018. Computational challenges of evolving the language-ready brain. Interaction Studies. Social Behaviour and Communication in Biological and Artificial Systems 19:1-2 ► pp. 7 ff.
Arbib, Michael A.
2020. Computational challenges of evolving the language-ready brain. In How the Brain Got Language – Towards a New Road Map [Benjamins Current Topics, 112], ► pp. 7 ff.
Arbib, Michael A., Francisco Aboitiz, Judith M. Burkart, Michael Corballis, Gino Coudé, Erin Hecht, Katja Liebal, Masako Myowa-Yamakoshi, James Pustejovsky, Shelby Putt, Federico Rossano, Anne E. Russon, P. Thomas Schoenemann, Uwe Seifert, Katerina Semendeferi, Chris Sinha, Dietrich Stout, Virginia Volterra, Sławomir Wacewicz & Benjamin Wilson
2018. The comparative neuroprimatology 2018 (CNP-2018) road map for research on How the Brain Got Language
. Interaction Studies. Social Behaviour and Communication in Biological and Artificial Systems 19:1-2 ► pp. 370 ff.
Arbib, Michael A., Francisco Aboitiz, Judith M. Burkart, Michael Corballis, Gino Coudé, Erin Hecht, Katja Liebal, Masako Myowa-Yamakoshi, James Pustejovsky, Shelby Putt, Federico Rossano, Anne E. Russon, P. Thomas Schoenemann, Uwe Seifert, Katerina Semendeferi, Chris Sinha, Dietrich Stout, Virginia Volterra, Sławomir Wacewicz & Benjamin Wilson
2020. The comparative neuroprimatology 2018 (CNP-2018) road map for research on How the Brain Got
Language
. In How the Brain Got Language – Towards a New Road Map [Benjamins Current Topics, 112], ► pp. 370 ff.
This list is based on CrossRef data as of 17 march 2026. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.
