Article published In: Bilingualism and Executive Function: An interdisciplinary approach
Edited by Irina A. Sekerina and Lauren Spradlin
[Linguistic Approaches to Bilingualism 6:5] 2016
► pp. 699–717
Cooking pasta in La Paz
Bilingualism, bias and the replication crisis
Published online: 24 June 2016
https://doi.org/10.1075/lab.16002.bak
https://doi.org/10.1075/lab.16002.bak
Abstract
Literature on bilingualism and cognition is characterised by a large amount of conflicting evidence. In some studies, bilinguals perform better then monolinguals on executive tasks involving inhibition, monitoring and switching but are slower on tasks of lexical processing. Other studies don’t find any significant effects and challenge the very existence of cognitive differences between monolinguals and bilinguals. In this paper I question the assumption that different studies performed in different parts of the world should yield the same results. I argue that the environment (in the widest sense of the word) in which an experiment is conducted can exert profound influence on its outcome. Against the background of the current debate about the replication crisis in science, I propose that conflicting evidence is not a threat to the trustworthiness of scientific research but a sign of the health of a discipline and a welcome opportunity to identify new relevant variables.
Keywords: bilingualism, replication, bias
Article outline
- 1.Controversy, conspiracy or consensus?
- 2.Are bilinguals better lovers? Myths, misconceptions and false dichotomies
- 2.1People are either monolingual or bilingual
- 2.2Either all or nothing, either good or bad
- 2.3Bilingualism prevents dementia
- 2.4Either chicken or egg
- 2.5Bilingualism, bilingualism and nothing but bilingualism
- 3.Bilingualism and the “replication crisis”
- 4.Cooking pasta in La Paz: why different studies produce different results
- Acknowledgements
References
References (67)
Abutalebi, J., Della Rosa, P.A., Ding, G., Weekes, B., Costa, A., & Green, D.W. (2013). Language proficiency modulates the engagement of cognitive control areas in multilinguals. Cortex, 49 (3), 905–911.
Alladi, S., Bak, T.H., Duggirala, V., Surampudi, B., Shailaja, M., Shukla, A.K., Kaul, S. (2013). Bilingualism delays age at onset of dementia, independent of education and immigration status. Neurology, 81 (22), 1938–1944.
Alladi, S., Bak, T.H., Mekala, S., Rajan, A., Chaudhuri, J.R., Mioshi, Kaul, S. (2015). Impact of Bilingualism on Cognitive Outcome After Stroke. Stroke, on-line publication: .
Andel, R., Kåreholt, I., Parker, M.G., Thorslund, M., & Gatz, M. (2007). Complexity of primary lifetime occupation and cognition in advanced old age. Journal of Aging and Health, 19 (3), 397–415.
Andel, R., Silverstein, M., & Kåreholt, I. (2014). The role of midlife occupational complexity and leisure activity in late-life cognition. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences, gbu110.
Bak, T., & Alladi, S. (2015). Bilingualism, dementia and the tale of many variables: why we need to move beyond the Western World. Cortex, Published on-line 4 July 2015.
Bak, T., Alladi, H, & Alladi, S. (2014). Can being bilingual affect the onset of dementia? Future Neurology, 9 (2), 101–103.
Bak, T.H. (2013a). The importance of looking in dark places. Amyotrophic lateral sclerosis and frontotemporal degeneration, 14 (1), 1–2.
(2013b). The neuroscience of action semantics in neurodegenerative brain diseases. Current opinion in neurology.
(2016). The impact of bilingualism on cognitive aging and dementia: finding a path through a forest of confounding variables. Linguistic Approaches to Bilingualism, Special Issue on Bilingualism and Ageing. Published on-line 25 January 2016.
Bak, T.H., & Chandran, S. (2012). What wires together dies together: verbs, actions and neurodegeneration in motor neuron disease. Cortex, 48 (7), 936–944.
Bak, T.H., Nissan, J.J., Allerhand, M.M., & Deary, I.J. (2014). Does bilingualism influence cognitive aging? Annals of Neurology.
Bak, T.H., Vega-Mendoza, M., & Sorace, A. (2014). Never too late? An advantage on tests of auditory attention extends to late bilinguals. Frontiers in psychology, 51.
Bialystok, E. (2009). Bilingualism: The good, the bad, and the indifferent. Bilingualism: Language and Cognition, 12 (01), 3–11.
Bialystok, E., Abutalebi, J., Bak, T.H., Burke, D., Kroll, J. (2016) Ageing in two languages: implications for public health. Ageing Research Reviews, Published on-line, 16 March 2016.
Bialystok, E., Craik, F.I., & Freedman, M. (2007). Bilingualism as a protection against the onset of symptoms of dementia. Neuropsychologia, 45 (2), 459–464.
Bialystok, E., & DePape, A.-M. (2009). Musical expertise, bilingualism, and executive functioning. Journal of Experimental Psychology: Human Perception and Performance, 35 (2), 565.
Bialystok, E., & Feng, X. (2009). Language proficiency and executive control in proactive interference: Evidence from monolingual and bilingual children and adults. Brain and Language, 109 (2), 93–100.
Cesar, K.G., Brucki, S.M., Takada, L.T., Nascimento, L.F., Gomes, C.M., Almeida, M.C., Bahia, V.S. (2015). Prevalence of Cognitive Impairment Without Dementia and Dementia in Tremembe, Brazil. Alzheimer disease and associated disorders: 10.1097.
Open Science Collaboration (2015). Estimating the reproducibility of psychological science. Science, 349 (6251), aac4716.
Costa, A., Hernández, M., Costa-Faidella, J., & Sebastián-Gallés, N. (2009). On the bilingual advantage in conflict processing: Now you see it, now you don’t. Cognition, 113 (2), 135–149.
de Bruin, A., Bak, T.H., & Della Sala, S. (2015). Examining the effects of active versus inactive bilingualism on executive control in a carefully matched non-immigrant sample. Journal of Memory and Language, 851, 15–26.
de Bruin, A., & Della Sala, S. (2015). The decline effect: How initially strong results tend to decrease over time. Cortex; a journal devoted to the study of the nervous system and behavior.
Duñabeitia, J.A., & Carreiras, M. (2015). The bilingual advantage: Acta est fabula. Cortex, 731, 371–372.
Duñabeitia, J.A., Hernández, J.A., Antón, E., Macizo, P., Estévez, A., Fuentes, L.J., & Carreiras, M. (2014). The inhibitory advantage in bilingual children revisited: Myth or reality? Experimental psychology, 61 (3), 234.
Easterbrook, P.J., Gopalan, R., Berlin, J., & Matthews, D.R. (1991). Publication bias in clinical research. The Lancet, 337 (8746), 867–872.
Ekman, P., & Friesen, W.V. (1971). Constants across cultures in the face and emotion. Journal of personality and social psychology, 17 (2), 124.
Ekman, P., Friesen, W.V., O’Sullivan, M., Chan, A., Diacoyanni-Tarlatzis, I., Heider, K., Ricci-Bitti, P.E. (1987). Universals and cultural differences in the judgments of facial expressions of emotion. Journal of personality and social psychology, 53 (4), 712.
Freedman, M., Alladi, S., Chertkow, H., Bialystok, E., Craik, F.I., Phillips, N.A., Bak, T.H. (2014). Delaying Onset of Dementia: Are Two Languages Enough? Behavioural Neurology, 2014: 808137.
Fuller-Thomson, E. (in press). Emerging evidence contradicts the hypothesis that bilingualism delays dementia onset. A Commentary on “Age of dementia diagnosis in community dwelling bilingual and monolingual Hispanic Americans” by Lawton et al., 2014. Cortex.
Fuller-Thomson, E., & Kuh, D. (2014). The healthy migrant effect may confound the link between bilingualism and delayed onset of Alzheimer’s disease. Cortex; a journal devoted to the study of the nervous system and behavior, 521, 128.
Fuller-Thomson, E., Milaszewski, D., & Abdelmessih, S.A. (2013). The importance of untangling the role of nativity and bilingualism in Alzheimer’s disease. Cortex; a journal devoted to the study of the nervous system and behavior, 49 (5), 1441; discussion 1442–1443.
Gold, B.T., Kim, C., Johnson, N.F., Kryscio, R.J., & Smith, C.D. (2013). Lifelong bilingualism maintains neural efficiency for cognitive control in aging. The Journal of Neuroscience, 33 (2), 387–396.
Gollan, T.H., Montoya, R.I., Fennema-Notestine, C., & Morris, S.K. (2005). Bilingualism affects picture naming but not picture classification. Memory & cognition, 33 (7), 1220–1234.
Gollan, T.H., Salmon, D.P., Montoya, R.I., & Galasko, D.R. (2011). Degree of bilingualism predicts age of diagnosis of Alzheimer’s disease in low-education but not in highly educated Hispanics. Neuropsychologia, 49 (14), 3826–3830.
Green, D.W. (2011). Language control in different contexts: the behavioral ecology of bilingual speakers. Frontiers in psychology, 21: 10.3389.
Green, D.W., & Abutalebi, J. (2013). Language control in bilinguals: The adaptive control hypothesis. Journal of Cognitive Psychology, 25 (5), 515–530.
Hasher L, Zacks RT, May, CP (1999) Inhibitory control, circadian arousal and age. In Gopher & Koriat (eds) Cognitive Regulation of Performance: p 563–575. MIT Press, Cambridge, MA.
Henrich, J., Heine, S.J., & Norenzayan, A. (2010). The weirdest people in the world? Behavioral and brain sciences, 33 (2–3), 61–83.
Ivanova, I., & Costa, A. (2008). Does bilingualism hamper lexical access in speech production? Acta psychologica, 127 (2), 277–288.
Iyer, G.K., Alladi, S., Bak, T.H., Shailaja, M., Mamidipudi, A., & Rajan, A. (2014). Dementia in developing countries: does education play the same role in India as in the West? Dement. neuropsychol, 8 (2).
Kavé, G., Eyal, N., Shorek, A., & Cohen-Mansfield, J. (2008). Multilingualism and cognitive state in the oldest old. Psychology and aging, 23 (1), 70.
Kosowicz, M., & MacPherson, S.E. (in press). Improving multitasking assessment in healthy older adults using a prop-based version of the breakfast task. Applied Neuropsychology: Adult.
Kovács, Á. M., & Mehler, J. (2009). Cognitive gains in 7-month-old bilingual infants. Proceedings of the National Academy of Sciences, 106 (16), 6556–6560.
Lawton, D.M., Gasquoine, P.G., & Weimer, A.A. (2014). Age of dementia diagnosis in community dwelling bilingual and monolingual Hispanic Americans. Cortex.
Linck, J.A., Kroll, J.F., & Sunderman, G. (2009). Losing access to the native language while immersed in a second language: Evidence for the role of inhibition in second-language learning. Psychological science, 20 (12), 1507–1515.
Ljungberg, J.K., Hansson, P., Andrés, P., Josefsson, M., & Nilsson, L.-G. (2013). A longitudinal study of memory advantages in bilinguals. PloS one, 8 (9), e73029.
Luk, G., & Bialystok, E. (2013). Bilingualism is not a categorical variable: Interaction between language proficiency and usage. Journal of Cognitive Psychology, 25 (5), 605–621.
Paap, K.R., & Greenberg, Z.I. (2013). There is no coherent evidence for a bilingual advantage in executive processing. Cognitive psychology, 66 (2), 232–258.
Paap, K.R., Johnson, H.A., & Sawi, O. (2015). Bilingual advantages in executive functioning either do not exist or are restricted to very specific and undetermined circumstances. Cortex.
Park, D.C., Lodi-Smith, J., Drew, L., Haber, S., Hebrank, A., Bischof, G.N., & Aamodt, W. (2014). The Impact of Sustained Engagement on Cognitive Function in Older Adults The Synapse Project. Psychological science, 25 (1), 103–112.
Saer, D.J. (1922). An Inquiry Into the Effect of Bilingualism Upon the Intelligence of Young Children. Journal of Experimental Pedagogy, 141, 25–38.
Schroeder, S.R., Marian, V., Shook, A., & Bartolotti, J. (2015). Bilingualism and Musicianship Enhance Cognitive Control. Neural Plasticity, 5011, 717861.
Smart, E.L., Gow, A.J., & Deary, I.J. (2014). Occupational complexity and lifetime cognitive abilities. Neurology, 83 (24), 2285–2291.
Sterling, T.D. (1959). Publication decisions and their possible effects on inferences drawn from tests of significance—or vice versa. Journal of the American statistical association, 54 (285), 30–34.
Stern, Y. (2002). What is cognitive reserve? Theory and research application of the reserve concept. Journal of the International Neuropsychological Society, 8 (03), 448–460.
Sumner, P., Vivian-Griffith, S., Boivin, J., Williams, A., Venetis, C.A., Davis, A., Ogden, J., Whelan, L., Hughes, B., Dalton, B., Boy, B., Chambers CD (2014) The associatio between exaggeration in health-related science and academic press releases: a retrospective observational study. British Medical Journal, 349, g:7015.
Tao, L., Marzecová, A., Taft, M., Asanowicz, D., & Wodniecka, Z. (2011). The efficiency of attentional networks in early and late bilinguals: the role of age of acquisition. Frontiers in psychology, 21: 10.3389.
Titone, D., & Baum, S. (2014). The future of bilingualism research: Insufferably optimistic and replete with new questions. Applied Psycholinguistics, 35 (05), 933–942.
Valian, V. (2015). Bilingualism and cognition: A focus on mechanisms. Bilingualism: Language and Cognition, 18 (01), 47–50.
Vega-Mendoza, M., West, H., Sorace, A., & Bak, T.H. (2015). The impact of late, non-balanced bilingualism on cognitive performance. Cognition, 1371, 40–46.
Woumans, E., & Duyck, W. (2015). The bilingual advantage debate: Moving toward different methods for verifying its existence. Cortex, 731, 356–357.
Woumans, E., Santens, P., Sieben, A., Versijpt, J., Stevens, M., & Duyck, W. (2015). Bilingualism delays clinical manifestation of Alzheimer’s disease. Bilingualism: Language and Cognition, 18 (03), 568–574.
Yang, H., Hartanto, A., & Yang, S. (in press). The importance of bilingual experience in assessing bilingual advantages in executive functions. Cortex.
Cited by (78)
Cited by 78 other publications
Bak, Thomas H. & Dina Mehmedbegović-Smith
Hansen, Pernille B., Magdalena Krysztofiak, Magdalena Łuniewska, Martyna Burdach, Katarina Hernæs, Jolanta Kilanowska, Grzegorz Krajewski, Karolina Krupa-Gaweł, Judyta Pacewicz, Mari Sandbakken, Ayla Skorpen, Anna Sara H. Romøren, Ewa Haman & Nina Gram Garmann
Lyu, Yumeng, Shane Lindsay, Shufang Wang & Yongliang Zheng
Takahesu Tabori, Andrea Akemi & Jennie E. Pyers
Wigdorowitz, Mandy
Xia, Lihua, Antonella Sorace, Mariana Vega-Mendoza & Thomas Bak
Zhang, Xueni, Binghan Zheng, Rui Wang & Haoshen He
Flege, James E.
Försterling, Marlene, Laura Hainke, Anna Redkina & Paul Sauseng
Giovannoli, Jasmine, Diana Martella & Maria Casagrande
Gosselin, Leah & Laura Sabourin
Luk, Gigi & John G. Grundy
Oostendorp, Marcelyn
Shaharban, N.V., B. Rangaiah & D. Thirumeni
Wigdorowitz, Mandy, Ana I. Pérez & Ianthi M. Tsimpli
Bialystok, Ellen & Fergus I.M. Craik
DeLuca, Vincent & Toms Voits
Kałamała, Patrycja, Jonas Walther, Haoyun Zhang, Michele Diaz, Magdalena Senderecka & Zofia Wodniecka
Kašćelan, Draško, Philippe Prévost, Ludovica Serratrice, Laurie Tuller, Sharon Unsworth & Cécile De Cat
Li, Heng & Shu Shen
Sala, Arianna, Maura Malpetti, Mohsen Farsad, Francesca Lubian, Giuseppe Magnani, Giulia Frasca Polara, Jean‐Benoit Epiney, Jubin Abutalebi, Frédéric Assal, Valentina Garibotto & Daniela Perani
Voits, Toms, Holly Robson, Jason Rothman & Christos Pliatsikas
Xia, Lihua, Thomas H. Bak, Antonella Sorace & Mariana Vega-Mendoza
Beatty-Martínez, Anne L. & Debra A. Titone
Cape, Ruth, Mariana Vega-Mendoza, Thomas H. Bak & Antonella Sorace
Haspelmath, Martin
Hofweber, Julia
Jansen, Silke, Sonja Higuera del Moral, Jessica Stefanie Barzen, Pia Reimann & Markus Opolka
Jansen, Silke, Sonja Higuera del Moral, Jessica Stefanie Barzen, Pia Reimann & Markus Opolka
Jansen, Silke, Sonja Higuera del Moral, Jessica Stefanie Barzen, Pia Reimann & Markus Opolka
Lahiri, Durjoy, Souvik Dubey, Alfredo Ardila, Debasish Sanyal & Biman Kanti Ray
Lahiri, Durjoy, Souvik Dubey, Alfredo Ardila & Biman Kanti Ray
López, Belem G, Minyu Zhang, Maria M Arredondo & Su Yeong Kim
Navarro-Torres, Christian A., Anne L. Beatty-Martínez, Judith F. Kroll & David W. Green
Ostadghafour, Sarvenaz & Ellen Bialystok
Romero, Celia & Lucina Q. Uddin
Stern, Michael C., LeeAnn Stover, Ernesto Guerra & Gita Martohardjono
Bialystok, Ellen
Bialystok, Ellen
Bialystok, Ellen
Bonfieni, Michela, Holly P. Branigan, Martin J. Pickering & Antonella Sorace
Kałamała, Patrycja, Jakub Szewczyk, Adam Chuderski, Magdalena Senderecka & Zofia Wodniecka
Lahiri, Durjoy, Souvik Dubey, Alfredo Ardila, Vishal Madhukar Sawale, Biman Kanti Roy, Souvik Sen & Goutam Gangopadhyay
Lewendon, Jennifer, Anouschka Foltz & Guillaume Thierry
Long, Madeleine R., Mariana Vega-Mendoza, Hannah Rohde, Antonella Sorace & Thomas H. Bak
Comishen, Kyle J., Ellen Bialystok & Scott A. Adler
Cox, Jessica G.
DeLuca, Vincent, Jason Rothman, Ellen Bialystok & Christos Pliatsikas
Hofweber, Julia, Theodoros Marinis & Jeanine Treffers-Daller
2019. Predicting executive functions in bilinguals using ecologically valid measures of code-switching behavior. In Bilingualism, Executive Function, and Beyond [Studies in Bilingualism, 57], ► pp. 181 ff.
Hofweber, Julia, Theodoros Marinis & Jeanine Treffers-Daller
Hofweber, Julia, Theodoros Marinis & Jeanine Treffers-Daller
Lahiri, Durjoy, Souvik Dubey, Alfredo Ardila, Vishal Madhukar Sawale, Gautam Das & Biman Kanti Ray
MacPherson, Sarah E., Celine R. Gillebert, Gail A. Robinson & Antonino Vallesi
Paplikar, Avanthi, Shailaja Mekala, Thomas H. Bak, Santosh Dharamkar, Suvarna Alladi & Subhash Kaul
Poarch, Gregory J. & Andrea Krott
Rosselli, Mónica, Idaly Vélez-Uribe & Valeria L. Torres
Struys, Esli, Jill Surmont, Piet Van de Craen, Olga Kepinska & Maurits Van den Noort
2019. Bilingual language control across modalities. Linguistic Approaches to Bilingualism 9:4-5 ► pp. 542 ff.
Struys, Esli, Jill Surmont, Piet Van de Craen, Olga Kepinska & Maurits Van den Noort
2021. Bilingual language control across modalities. In Psycholinguistic Approaches to Production and Comprehension in Bilingual Adults and Children [Benjamins Current Topics, 117], ► pp. 39 ff.
SUBRAMANIAPILLAI, SIVANIYA, MARIA NATASHA RAJAH, STAMATOULA PASVANIS & DEBRA TITONE
SURRAIN, SARAH & GIGI LUK
Vega‐Mendoza, Mariana, Suvarna Alladi & Thomas H. Bak
Whitford, Veronica & Gigi Luk
2019. Comparing executive functions in monolinguals and bilinguals. In Bilingualism, Executive Function, and Beyond [Studies in Bilingualism, 57], ► pp. 67 ff.
Calvo, Noelia, Agustín Ibáñez, Edinson Muñoz & Adolfo M. García
Del Maschio, Nicola, Simone Sulpizio, Federico Gallo, Davide Fedeli, Brendan S. Weekes & Jubin Abutalebi
Kałamała, Patrycja, Anna Drożdżowicz, Jakub Szewczyk, Anna Marzecová & Zofia Wodniecka
Maschio, Nicola Del & Jubin Abutalebi
2018. Neurobiology of bilingualism. In
Bilingual Cognition and Language [Studies in Bilingualism, 54], ► pp. 325 ff.
Poarch, Gregory J.
Pot, Anna, Merel Keijzer & Kees De Bot
Schroeder, Scott R.
Takahesu Tabori, Andrea A., Emily N. Mech & Natsuki Atagi
Alladi, Suvarna, Thomas H. Bak, Mekala Shailaja, Divyaraj Gollahalli, Amulya Rajan, Bapiraju Surampudi, Michael Hornberger, Vasanta Duggirala, Jaydip Ray Chaudhuri & Subhash Kaul
Bak, Thomas H. & Ian Robertson
Cachia, Arnaud, Nicola Del Maschio, Gregoire Borst, Pasquale Anthony Della Rosa, Christophe Pallier, Albert Costa, Olivier Houdé & Jubin Abutalebi
Piccardo, Enrica
Poarch, Gregory J. & Ellen Bialystok
Tomczak, Ewa & Dorota Jaworska-Pasterska
Cox, Simon R., Thomas H. Bak, Michael Allerhand, Paul Redmond, John M. Starr, Ian J. Deary & Sarah E. MacPherson
Sekerina, Irina A. & Lauren Spradlin
This list is based on CrossRef data as of 23 november 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.
