Article published In: Bilingualism and Executive Function: An interdisciplinary approach
Edited by Irina A. Sekerina and Lauren Spradlin
[Linguistic Approaches to Bilingualism 6:5] 2016
► pp. 517–534
The signal and the noise
Finding the pattern in human behavior
Published online: 4 May 2016
https://doi.org/10.1075/lab.15040.bia
https://doi.org/10.1075/lab.15040.bia
Abstract
Studies on the effect of bilingualism on executive functioning have sometimes failed to find significant differences between performance of monolingual and bilingual young adults. This paper examines the interpretation of these null findings and considers the role of three factors: definition of bilingualism, appropriateness of statistical procedures and interpretations, and the range of data considered. The conclusion is that a correct interpretation of this important issue will require careful consideration of all the data and scrupulous attention to design details.
Keywords: bilingualism, executive function, null results
Article outline
- 1.Introduction
- 2.Reaction time tasks and language experience
- 3.Defining bilingualism
- 4.What the numbers mean
- 5.Selecting the measure
- Conclusions
References
References (58)
Abutalebi, J., Della Rosa, P. A., Green, D. W., Hernandez, M., Scifo, P., Keim, R., … Costa, A. (2012). Bilingualism tunes the anterior cingulate cortex for conflict monitoring. Cerebral Cortex, 221, 2076–2086.
Adi-Japha, E., Berberich-Artzi, J., & Libnawi, A. (2010). Cognitive flexibility in drawings of bilingual children. Child Development, 811, 1356–1366.
Altman, D. G., & Bland, J. M. (1995). Absence of evidence is not evidence of absence. British Medical Journal, 3111, 485.
Bialystok, E., Craik, F.I.M., Green, D.W., & Gollan, T.H. (2009). Bilingual minds. Psychological Science in the Public Interest, 101, 89–129.
Bialystok, E., Craik, F. I. M., Klein, R., & Viswanathan, M. (2004). Bilingualism, aging, and cognitive control: Evidence from the Simon task. Psychology and Aging, 191, 290–303.
Bialystok, E., Luk, G., Peets, K. F., & Yang, S. (2010). Receptive vocabulary differences in monolingual and bilingual children. Bilingualism: Language and Cognition, 131, 525–531.
Bialystok, E., Martin, M. M., & Viswanathan, M. (2005). Bilingualism across the lifespan: The rise and fall of inhibitory control. International Journal of Bilingualism, 91, 103–119.
Blom, E., Kuntay, A. C., Messer, M., Verhagen, J., & Leseman, P. (2014). The benefits of being bilingual: Working memory in bilingual Turkish-Dutch children. Journal of Experimental Child Psychology, 128C1, 105–119.
Blumenfeld, H. K., & Marian, V. (2014). Cognitive control in bilinguals: Advantages in Stimulus-Stimulus inhibition. Bilingualism: Language and Cognition, 171, 610–629.
Calvo, A., & Bialystok, E. (2014). Independent effects of bilingualism and socioeconomic status on language ability and executive functioning. Cognition, 1301, 278–288.
Carlson, S. M., & Meltzoff, A. N. (2008). Bilingual experience and executive functioning in young children. Developmental Science, 111, 282–298.
Colzato, L. S., Bajo, M. T., van den Wildenberg, W., Paolieri, D., Nieuwenhuis, S., La Heij, W., & Hommel, B. (2008). How does bilingualism improve executive control? A comparison of active and reactive inhibition mechanisms. Journal of Experimental Psychology: Learning, Memory and Cognition, 341, 302–312.
Costa, A., Hernandez, M., & Sebastian-Galles, N. (2008). Bilingualism aids conflict resolution: evidence from the ANT task. Cognition, 1061, 59–86.
de Bruin, A., Treccani, B., & Della Sala, S. (2015). Cognitive advantage in bilingualism: an example of publication bias? Psychological Science, 261, 99–107.
Dunabeitia, J. A., Hernandez, J. A., Anton, E., Macizo, P., Estevez, A., Fuentes, L. J., & Carreiras, M. (2014). The inhibitory advantage in bilingual children revisited: myth or reality? Experimental Psychology, 611, 234–251.
Engel de Abreu, P. M., Cruz-Santos, A., Tourinho, C. J., Martin, R., & Bialystok, E. (2012). Bilingualism enriches the poor: Enhanced cognitive control in low-income minority children. Psychological Science, 231, 1364–1371.
Engle, R. W., Laughlin, J. E., Tuholski, S. W., & Conway, A. R. (1999). Working Memory, Short-Term Memory, and General Fluid Intellignece: A Latent-Variable Approach. Journal of Experimental Psychology: General, 1281, 309–331.
Esposito, A. G., Baker-Ward, L., & Mueller, S. T. (2013). Interference suppression vs. response inhibition: An explanation for the absence of a bilingual advantage in preschoolers’ Stroop task performance. Cognitive Development, 281, 354–363.
Filippi, R., Morris, J. C., Richardson, F. M., Bright, P., Thomas, M. S. C., Karmiloff-Smith, A., & Marian, V. (2015). Bilingual children show an advantage in controlling verbal interference during spoken language comprehension. Bilingualism: Language and Cognition, 181, 490–501.
Gathercole, V. C., Thomas, E. M., Kennedy, I., Prys, C., Young, N., Vinas Guasch, N., … Jones, L. (2014). Does language dominance affect cognitive performance in bilinguals? Lifespan evidence from preschoolers through older adults on card sorting, Simon, and metalinguistic tasks. Frontiers in Psychology, 51, 11.
Gold, B. T., Johnson, N. F., & Powell, D. K. (2013). Lifelong bilingualism contributes to cognitive reserve against white matter integrity declines in aging. Neuropsychologia, 511, 2841–2846.
Grady, C. L., Luk, G., Craik, F. I., & Bialystok, E. (2015). Brain network activity in monolingual and bilingual older adults. Neuropsychologia, 661, 170–181.
Hervais-Adelman, A. G., Moser-Mercer, B., & Golestani, N. (2011). Executive control of language in the bilingual brain: integrating the evidence from neuroimaging to neuropsychology. Frontiers in Psychology, 21, 234.
Hilchey, M. D., & Klein, R. M. (2011). Are there bilingual advantages on nonlinguistic interference tasks? Implications for the plasticity of executive control processes. Psychonomic Bulletin and Review, 181, 625–658.
Kalia, V., Wilbourn, M. P., & Ghio, K. (2014). Better early or late? Examining the influence of age of exposure and language proficiency on executive function in early and late bilinguals. Journal of Cognitive Psychology, 261, 699–713.
Kempert, S., Saalbach, H., & Hardy, I. (2011). Cognitive benefits and costs of bilingualism in elementary school students: The case of mathematical word problems. Journal of Educational Psychology, 1031, 547–561.
Kousaie, S., & Phillips, N. A. (2012). Conflict monitoring and resolution: are two languages better than one? Evidence from reaction time and event-related brain potentials. Brain Research, 14461, 71–90.
Kousaie, S., Sheppard, C., Lemieux, M., Monetta, L., & Taler, V. (2014). Executive function and bilingualism in young and older adults. Frontiers in Behavioral Neuroscience, 81, 250.
Kramer, A. F., Bherer, L., Colcombe, S. J., Dong, W., & Greenough, W. T. (2004). Environmental influences on cognitive and brain plasticity during aging. Journal of Gerontology:Medical Sciences, 59A1, 940–957.
Kramer, A. F., & Erickson, K. I. (2007). Capitalizing on cortical plasticity: influence of physical activity on cognition and brain function. Trends in Cognitive Sciences, 111, 342–348.
Krizman, J., Skoe, E., & Kraus, N. (in press). Bilingual enhancements have no socioeconomic boundaries. Developmental Science. doi:
Kroll, J. F., & Bialystok, E. (2013). Understanding the consequences of bilingualism for language processing and cognition. Journal of Cognitive Psychology, 251, 497–514.
Kroll, J. F., Dussias, P. E., Bogulski, C. A., & Valdes-Kroff, J. (2012). Juggling two languages in one mind: What bilinguals tell us about language processing and its consequences for cognition. In B. Ross (Ed.), The Psychology of Learning and Motivation (Vol. 561, pp. 229–262). San Diego: Academic Press.
Li, L., Abutalebi, J., Zou, L., Yan, X., Liu, L., Feng, X., … Ding, G. (2015). Bilingualism alters brain functional connectivity between “control” regions and “language” regions: Evidence from bimodal bilinguals. Neuropsychologia, 711, 236–247.
Luk, G. (2008). The anatomy of the bilingual influence on cognition: Levels of functional use and proficiency of language. Unpublished doctoral dissertation, York University, Toronto, Canada.
Luk, G., Anderson, J. A. E., Craik, F. I. M., Grady, C., & Bialystok, E. (2010). Distinct neural correlates for two types of inhibition in bilinguals: Response inhibition and intereference supression. Brain and Cognition, 741, 347–357.
Luk, G., & Bialystok, E. (2013). Bilingualism is not a categorical variable: Interaction between language proficiency and usage. Journal of Cognitive Psychology, 251, 605–621.
Luk, G., Bialystok, E., Craik, F. I. M., & Grady, C. L. (2011). Lifelong bilingualism maintains white matter integrity in older adults. Journal of Neuroscience, 311, 16808–16813.
Marzecova, A., Asanowicz, D., Kriva, L., & Wodniecka, Z. (2013). The effects of bilingualism on efficiency and lateralization of attentional networks. Bilingualism: Language and Cognition, 161, 608–623.
Mechelli, A., Crinion, J. T., Noppeney, U., O' Doherty, J., Ashburner, J., Frackowiak, R. S., & Price, C. J. (2004). Structural plasticity in the bilingual brain. Nature, 4311, 757.
Mezzacappa, E. (2004). Alerting, orienting, and executive attention: Developmental properties and sociodemographic correlates in an epidemiological sample of young, urban children. Child Development, 751, 1373–1386.
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex “Frontal Lobe” tasks: a latent variable analysis. Cognitive Psychology, 411, 49–100.
Morales, J., Yudes, C., Gomez-Ariza, C. J., & Bajo, M. T. (2014). Bilingualism modulates dual mechanisms of cognitive control: Evidence from ERPs. Neuropsychologia, 66C1, 157–169.
Morton, J. P., & Harper, S. N. (2007). What did Simon say? Revisiting the bilingual advantage. Developmental Science, 101, 719–726.
Noble, K. G., Norman, M. F., & Farah, M. J. (2005). Neurocognitive correlates of socioeconomic status in kindergarten children. Developmental Science, 81, 74–87.
Paap, K. R., & Greenberg, Z. I. (2013). There is no coherent evidence for a bilingual advantage in executive processing. Cognitive Psychology, 661, 232–258.
Paap, K. R., Johnson, H.A., & Sawi, O. (2015a). Are bilingual advantages dependent upon specific tasks or specific bilingual experiences? Journal of Cognitive Psychology, 261, 615–639.
Paap, K. R., Johnson, H. A., & Sawi, O. (2015b). Bilingual advantages in executive functioning either do not exist or are restricted to very specific and undetermined circumstances. Cortex, 691, 265–78.
Pelham, S. D., & Abrams, L. (2014). Cognitive Advantages and Disadvantages in Early and Late Bilinguals. Journal of Experimental Psychology: Learning, Memory, and Cognition, 401, 313–325.
Pliatsikas, C., Moschopoulou, E., & Saddy, J. D. (2015). The effects of bilingualism on the white matter structure of the brain. Proceedings of the National Academy of Sciences, 1121, 1334–1337.
Prior, A., & Macwhinney, B. (2010). A bilingual advantage in task switching. Bilingualism: Language and Cognition, 131, 253–262.
Silver, N. (2012). The signal and the noise: Why so many predictions fail -- but some don't. New York: Penguin.
Tao, L., Marzecova, A., Taft, M., Asanowicz, D., & Wodniecka, Z. (2011). The efficiency of attentional networks in early and late bilinguals: the role of age of acquisition. Frontiers in Psychology, 21, 123.
Treccani, B., Argyri, E., Sorace, A., & Sala, S. D. (2009). Spatial negative priming in bilingualism. Psychonomic Bulletin and Review, 161, 320–327.
von Bastian, C. C., Souza, A. S., & Gade, M. (in press). No evidence for bilingual cognitive advantages: A test of four hypotheses. Journal of Experimental Psychology: General. doi:
Yang, S., Yang, H., & Lust, B. (2011). Early childhood bilingualism leads to advances in executive attention: Dissociating culture and language. Bilingualism: Language and Cognition, 141, 412–422.
Zhou, B., & Krott, A. (in press). Data trimming procedure can eliminate bilingual cognitive advantage. Psychonomics Bulletin and Review.
Cited by (65)
Cited by 65 other publications
Coco, M. I., G. Smith, R. Spelorzi & M. Garraffa
Gallo, F., A. Myachykov, J. Abutalebi, V. DeLuca, J. Ellis, J. Rothman & L.R. Wheeldon
Smith, Giuditta, Roberta Spelorzi, Antonella Sorace & Maria Garraffa
Zhou, Yu & Adam John Privitera
Fann, Helen, Patrick Pieng & Lisa M. Soederberg Miller
Garcia-Alcaraz, Estela & Juana M. Liceras
Garcia-Alcaraz, Estela & Juana M. Liceras
Garcia-Alcaraz, Estela & Juana M. Liceras
Mertins, Barbara, Joël Alipaß & Katrin Odermann
Privitera, Adam John & Brendan Weekes
Rothman, Jason, Fatih Bayram, Vincent DeLuca, Jorge González Alonso, Maki Kubota & Eloi Puig-Mayenco
2023. Defining bilingualism as a continuum. In Understanding Language and Cognition through Bilingualism [Studies in Bilingualism, 64], ► pp. 38 ff.
Bialystok, Ellen & Fergus I.M. Craik
Luk, Gigi & Jason Rothman
Privitera, Adam John, Mohammad Momenian & Brendan Weekes
Privitera, Adam John, Mohammad Momenian & Brendan Weekes
Wagner, Danika, Ellen Bialystok & John G. Grundy
Aveledo, Fraibet, Yolanda Higueras, Theodoros Marinis, Arpita Bose, Christos Pliatsikas, Ariana Meldaña-Rivera, María Luisa Martínez-Ginés, José Manuel García-Domínguez, Alberto Lozano-Ros, Juan Pablo Cuello & Haydee Goicochea-Briceño
Bayram, Fatih, Maki Kubota, Alicia Luque, Diego Pascual y Cabo & Jason Rothman
Bylund, Emanuel, Kenneth Hyltenstam & Niclas Abrahamsson
Francot, Ryanne, Elma Blom, Martine Broekhuizen & Paul Leseman
Gallo, Federico, Nikolay Novitskiy, Andriy Myachykov & Yury Shtyrov
Jones, Samuel Kyle, Jodie Davies-Thompson & Jeremy Tree
Kuipers, Jan R. & Karla H. Westphal
Leivada, Evelina, Marit Westergaard, Jon Andoni Duñabeitia & Jason Rothman
Ostadghafour, Sarvenaz & Ellen Bialystok
Pereira Soares, Sergio Miguel, Maki Kubota, Eleonora Rossi & Jason Rothman
Romero, Celia & Lucina Q. Uddin
Anderson, John A. E., Kornelia Hawrylewicz & Ellen Bialystok
Atagi, Natsuki & Catherine M. Sandhofer
Atagi, Natsuki & Catherine M. Sandhofer
Bayram, Fatih & Jason Rothman
DeLuca, Vincent, Katrien Segaert, Ali Mazaheri & Andrea Krott
Flognfeldt, Mona Evelyn, Dina Tsagari, Dragana Šurkalović & Therese Tishakov
Kałamała, Patrycja, Jakub Szewczyk, Adam Chuderski, Magdalena Senderecka & Zofia Wodniecka
Kubota, Maki, Nicolas Chevalier & Antonella Sorace
Paap, Kenneth R, Lauren Mason, Brandon Zimiga, Yocelyne Ayala-Silva & Matthew Frost
Sanchez-Azanza, Victor A., Raúl López-Penadés, Eva Aguilar-Mediavilla & Daniel Adrover-Roig
Thanissery, Nithin, Priyanka Parihar & Bhoomika Rastogi Kar
Bylund, Emanuel, Niclas Abrahamsson, Kenneth Hyltenstam & Gunnar Norrman
DeLuca, Vincent, David Miller, Christos Pliatsikas & Jason Rothman
DeLuca, Vincent, Jason Rothman, Ellen Bialystok & Christos Pliatsikas
DeLuca, Vincent, Jason Rothman, Ellen Bialystok & Christos Pliatsikas
DELUCA, VINCENT, JASON ROTHMAN & CHRISTOS PLIATSIKAS
Johns, Michael A, Jorge R Valdés Kroff & Paola E Dussias
Paap, Kenneth
Rothman, Jason, Jorge González Alonso & Eloi Puig-Mayenco
Bayram, Fatih, David Miller, Jason Rothman & Ludovica Serratrice
2018. Studies in bilingualism. In
Bilingual Cognition and Language [Studies in Bilingualism, 54], ► pp. 1 ff.
Berch, Daniel B., David C. Geary & Kathleen Mann Koepke
Bialystok, Ellen
2018. Bilingualism and executive function. In
Bilingual Cognition and Language [Studies in Bilingualism, 54], ► pp. 283 ff.
Bialystok, Ellen
Bialystok, Ellen
Grundy, John G. & Ellen Bialystok
Mishra, Ramesh Kumar
Schroeder, Scott R.
Takahesu Tabori, Andrea A., Emily N. Mech & Natsuki Atagi
Alonso, Jorge González, Jason Rothman, Denny Berndt, Tammer Castro & Marit Westergaard
Anderson, John A.E., Somayya Saleemi & Ellen Bialystok
Grundy, John G., Ashley Chung-Fat-Yim, Deanna C. Friesen, Lorinda Mak & Ellen Bialystok
Pliatsikas, Christos, Vincent DeLuca, Elisavet Moschopoulou & James Douglas Saddy
Poarch, Gregory J. & Ellen Bialystok
Bayram, Fatih, Josh Prada, Diego Pascual y Cabo & Jason Rothman
Bayram, Fatih, Josh Prada, Diego Pascual y Cabo & Jason Rothman
Bayram, Fatih, Josh Prada, Diego Pascual y Cabo & Jason Rothman
Sekerina, Irina A. & Lauren Spradlin
[no author supplied]
This list is based on CrossRef data as of 23 november 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.
