Cover not available

Article published In: Linguistic Approaches to Bilingualism
Vol. 14:3 (2024) ► pp.400–433

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
EPUB logo with download linkDownload EPUB
authorization required

The Bilingual Code-Switching Profile (BCSP)

Assessing the reliability and validity of the BCSP questionnaire

ORCiD logo with link | Purdue University
Published online: 13 October 2022
DOI logo with link
https://doi.org/10.1075/lab.21039.ols
Abstract
Significant variation exists in bilinguals’ experiences with code-switching, from dense code-switching in multiple interactional contexts to minimal switching. Although recent research has demonstrated that a bilingual’s experience with code-switching is a crucial factor for determining both linguistic and cognitive behaviors, there currently is no commonly accepted method of measuring of a bilingual’s code-switching practices. Responding to this need, this paper presents a new tool to assess a bilingual’s experience and engagement with code-switching – the Bilingual Code-Switching Profile (BCSP) – and assesses its validity and reliability. The BCSP incorporates a multifaceted conceptualization of code-switching experience, drawing on previous research in bilingual proficiency, and addresses a bilingual’s code-switching history, use, proficiency, and attitudes. To assess the validity and reliability of the BCSP, Spanish–English bilinguals (N = 454) from a wide range of ages, ethnic backgrounds, national origins, and language dominance profiles completed the questionnaire. Results of an exploratory factor analysis and intraclass correlation on test-retest data (N = 248) demonstrate that the BCSP is a valid and reliable method of assessing a bilingual’s code-switching profile. The BCSP can be easily and practically incorporated into future research on bilinguals to provide a systematic measure of an individual’s code-switching profile.
Article outline
  • 1.Introduction
    • 1.1The impact of CS experience
    • 1.2Failure to measure CS in bilingualism research
    • 1.3Lack of accepted measure of CS practices
    • 1.4Study aims
  • 2.Instrument design, translation, and pretesting
    • 2.1The Bilingual Code-Switching Profile framework
      • 2.1.1BCSP introduction
      • 2.1.2BCSP items
    • 2.2Questionnaire translation
    • 2.3Pretesting of the BCSP via cognitive interview
    • 2.4BCSP scoring
  • 3.Methods for validity and reliability assessment
    • 3.1Participants
    • 3.2Procedure
    • 3.3Analysis
  • 4.Results
    • 4.1Factor analysis
    • 4.2Test-retest reliability
    • 4.3Analysis by community characteristics
  • 5.Discussion
    • 5.1Using the BCSP
    • 5.2Limitations and future work
  • Acknowledgements
  • Notes
  • References
References (65)
References
Anderson, J. A., Mak, L., Chahi, A. K., & Bialystok, E. (2018). The language and social background questionnaire: Assessing degree of bilingualism in a diverse population. Behavior Research Methods, 50(1), 250–263. Google Scholar logo with link to Google Scholar
Badiola, L., Delgado, R., Sande, A., & Stefanich, S. (2018). Code-switching attitudes and their effects on acceptability judgment tasks. Linguistic Approaches to Bilingualism, 8(1), 5–24. Google Scholar logo with link to Google Scholar
Beatty-Martínez, A. L., & Titone, D. A. (2021). The quest for signals in noise: Leveraging experiential variation to identify bilingual phenotypes. Languages, 61, Article 168. Google Scholar logo with link to Google Scholar
Berinsky, A. J., Margolis, M. F., & Sances, M. W. (2013). Separating the shirkers from the workers? Making sure respondents pay attention on self-administered surveys. American Journal of Political Science, 58(3), 739–753. Google Scholar logo with link to Google Scholar
Birdsong, D., Gertken, L. M., & Amengual, M. (2012). Bilingual Language Profile: An Easy-to-Use Instrument to Assess Bilingualism. COERLL, University of Texas at Austin. [URL]
Bland, J. M., & Altman, D. G. (1986). Statistical methods for assessing agreement between two methods of clinical measurement. The Lancet, 327(8476), 307–310. Google Scholar logo with link to Google Scholar
Bureau of Labor Statistics. (2020). American Time Use Survey – May to December 2019 and 2020 results. Bureau of Labor Statistics, U.S. Department of Labor. [URL]
Cox, J. G., LaBoda, A., & Mendes, N. (2020). “I’m gonna Spanglish it on you”: Self-reported vs. oral production of Spanish-English codeswitching. Bilingualism: Language and Cognition, 231, 446–458. Google Scholar logo with link to Google Scholar
de Bruin, A. (2019). Not all bilinguals are the same: A call for more detailed assessments and descriptions of bilingual experiences. Behavioral Sciences, 9(33), 1–13. Google Scholar logo with link to Google Scholar
de Bruin, A., Bak, T. H., & Della Sala, S. (2015). Examining the effects of active versus inactive bilingualism on executive control in a carefully matched non-immigrant sample. Journal of Memory and Language, 851, 15–26. Google Scholar logo with link to Google Scholar
Delgado, P., Guerrero, G., Goggin, J. P., & Ellis, B. B. (1999). Self-assessment of linguistic skills by bilingual Hispanics. Hispanic Journal of Behavioral Sciences, 21(1), 31–46. Google Scholar logo with link to Google Scholar
Dewaele, J. M., & Wei, L. (2014). Attitudes towards code-switching among adult mono- and multilingual language users. Journal of Multilingual and Multicultural Development, 35(3), 235–251. Google Scholar logo with link to Google Scholar
Flege, J. E., MacKay, I. R., & Piske, T. (2002). Assessing bilingual dominance. Applied Psycholinguistics, 23(4), 567–598. Google Scholar logo with link to Google Scholar
Gardner-Chloros, P. (2009). Sociolinguistic factors in code-switching. In B. Bullock & A. J. Toribio (Eds.), The Cambridge handbook of linguistic code-switching (pp. 97–113). Cambridge University Press. Google Scholar logo with link to Google Scholar
Genesee, F. (2016). Shifting perspectives on bilingualism. In E. Nicoladis, S. Montanari, & J. MacSwan (Eds.), Bilingualism across the lifespan (pp. 9–19). De Gruyter Mouton. Google Scholar logo with link to Google Scholar
Gertken, L. M., Amengual, M., & Birdsong, D. (2014). Assessing language dominance with the bilingual language profile. In P. Leclercq, A. Edmonds, & H. Hilton (Eds.), Measuring L2 proficiency: Perspectives from SLA (pp. 208–225). Multilingual Matters. Google Scholar logo with link to Google Scholar
Green, D. W. (2011). Language control in different contexts: The behavioral ecology of bilingual speakers. Frontiers in Psychology, 21, 1–4. Google Scholar logo with link to Google Scholar
Green, D. W., & Abutalebi, J. (2013). Language control in bilinguals: The adaptive control hypothesis. Journal of Cognitive Psychology, 25(5), 515–530. Google Scholar logo with link to Google Scholar
Gullifer, J. W., & Titone, D. (2020). Characterizing the social diversity of bilingualism using language entropy. Bilingualism: Language and Cognition, 23(2), 283–294. Google Scholar logo with link to Google Scholar
Harris, C. L., Gleason, J. B., & Aycicegi, A. (2006). When is a first language more emotional? Psychophysiological evidence from bilingual speakers. In A. Pavlenko (Ed.), Bilingual minds: Emotional experience, expression, and representation (pp. 257–283). Multilingual Matters. Google Scholar logo with link to Google Scholar
Hartanto, A., & Yang, H. (2016). Disparate bilingual experiences modulate task-switching advantages: A diffusion-model analysis of the effects of interactional context on switch costs. Cognition, 1501, 10–19. Google Scholar logo with link to Google Scholar
Hauser, D. J., & Schwarz, N. (2016). Attentive Turkers: MTurk participants perform better online attention checks than do subject pool participants. Behavioral Research, 481, 400–407. Google Scholar logo with link to Google Scholar
Heredia, R. (1997). Bilingual memory and hierarchical models: A case for language dominance. Current Directions in Psychological Science, 61, 34–39. Google Scholar logo with link to Google Scholar
Hofweber, J., Marinis, T., & Treffers-Daller, J. (2019). Predicting executive functions in bilinguals using ecologically valid measures of code-switching behaviour. In I. Sekerina, L. Spradlin, & V. Valian (Eds). Bilingualism, executive function and beyond: Questions and insights (pp. 181–205). Studies in Bilingualism. John Benjamins. Google Scholar logo with link to Google Scholar
Hulstijn, J. H. (2011). Language proficiency in native and nonnative speakers: An agenda for research and suggestions for second-language assessment. Language Assessment Quarterly, 8(3), 229–249. Google Scholar logo with link to Google Scholar
Jevtović, M., Duñabeitia, J. A., & de Bruin, A. (2020). How do bilinguals switch between languages indifferent interactional contexts? A comparison between voluntary and mandatory language switching. Bilingualism: Language and Cognition, 231, 401–413. Google Scholar logo with link to Google Scholar
Jylkkä, J., Soveri, A., Wahlström, J., Lehtonen, M., Rodríguez-Fornells, A., & Laine, M. (2017). Relationship between language switching experience and executive functions in bilinguals: an Internet-based study. Journal of Cognitive Psychology, 29(4), 404–419. Google Scholar logo with link to Google Scholar
Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. Google Scholar logo with link to Google Scholar
Lai, G., & O’Brien, B. A. (2020). Examining language switching and cognitive control through the Adaptive Control Hypothesis. Frontiers in Psychology, 111, 1171. Google Scholar logo with link to Google Scholar
Li, P., Zhang, F., Yu, A., & Zhao, X. (2020). Language History Questionnaire (LHQ3): An enhanced tool for assessing multilingual experience. Bilingualism: Language and Cognition, 23(5), 938–944. Google Scholar logo with link to Google Scholar
MacSwan, J. (2014). Grammatical theory and bilingual codeswitching. MIT Press. Google Scholar logo with link to Google Scholar
(2016). Code-switching in adulthood. In E. Nicoladis, S. Montanari, & J. MacSwan (Eds.), Bilingualism across the lifespan (pp. 183–200). De Gruyter Mouton. Google Scholar logo with link to Google Scholar
Marian, V., Blumenfeld, H. K., & Kaushanskaya, M. (2007). The Language Experience and Proficiency Questionnaire (LEAP-Q): Assessing language profiles in bilinguals and multilinguals. Journal of Speech, Language, and Hearing Research, 50(4), 940–967. Google Scholar logo with link to Google Scholar
Meuter, R. F. I., & Allport, A. (1999). Bilingual language switching in naming: Asymmetrical costs of language selection. Journal of Memory and Language, 401, 25–40. Google Scholar logo with link to Google Scholar
Montes-Alcalá, C. (2000). Attitudes towards oral and written codeswitching in Spanish-English bilingual youths. In A. Roca (Ed.), Research on Spanish in the US (pp. 218–227). Cascadilla Press.Google Scholar logo with link to Google Scholar
Montrul, S. (2016). Dominance and proficiency in early and late bilingualism. In C. Silva-Corvalán & J. Treffers-Daller (Eds.), Language dominance in bilinguals: Issues of measurement and operationalization (pp. 15–35). Wiley-Blackwell.Google Scholar logo with link to Google Scholar
Muysken, P. (2000). Bilingual speech: A typology of code-mixing. Cambridge University Press.Google Scholar logo with link to Google Scholar
(2013). Language contact outcomes as the result of bilingual optimization strategies. Bilingualism: Language and Cognition, 16(4), 709–730. Google Scholar logo with link to Google Scholar
Myers-Scotton, C. (1993). Social motivations for code-switching. Clarendon Press.Google Scholar logo with link to Google Scholar
Olson, D. J. (2013). Bilingual language switching and selection at the phonetic level: Asymmetrical transfer in VOT production. Journal of Phonetics, 411, 407–420. Google Scholar logo with link to Google Scholar
(2016). The role of code-switching and language context in bilingual phonetic transfer. Journal of the International Phonetic Association, 46(3), 263–285. Google Scholar logo with link to Google Scholar
Olson, D. J., Deemer, E., & King, J. (2021). A systematic review of proficiency assessment methods in bilingualism research [Paper Presentation]. Bilingualism Matters Research Symposium.Google Scholar logo with link to Google Scholar
Ortega-Santos, I. (2019). Crowdsourcing for Hispanic linguistics: Amazon’s mechanical turk as a source of Spanish data. Borealis: An International Journal of Hispanic Linguistics, 8(1), 187–215. Google Scholar logo with link to Google Scholar
Paap, K. R., Myuz, H. A., Anders, R. T., Bockelman, M. F., Mikulinsky, R., & Sawi, O. M. (2017). No compelling evidence for a bilingual advantage in switching or that frequent language switching reduces switch cost. Journal of Cognitive Psychology, 29(2), 89–112. Google Scholar logo with link to Google Scholar
Peer, E., Vosgerau, J., & Acquisti, A. (2014). Reputation as a sufficient condition for data quality on Amazon Mechanical Turk. Behavioral Research Methods, 46(4), 1023–1031. Google Scholar logo with link to Google Scholar
Pérez Casas, M. (2008). Codeswitching and identity among island Puerto Rican bilinguals. [Unpublished doctoral dissertation]. Georgetown University.
Phan, T. (2016). An Introduction to Principal Component Analysis with Examples in R. Technical Report. Retrieved from [URL]
R Core Team. (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. [URL]
Revelle, W. (2021). psych: Procedures for psychological, psychometric, and personality research. R package version 2.1.3. [URL]
Rodriguez-Fornells, A., Kramer, U., Lorenzo-Seva, U., Festman, J., & Münte, T. F. (2012). Self-assessment of individual differences in language switching. Frontiers in Psychology, 2, 388, 1–15. Google Scholar logo with link to Google Scholar
Scimago. (n.d.). Scimago Journal and Country Rank: Language and Linguistics. Retrieved September 20, 2019, from [URL]
Tomoschuk, B., Ferreira, V. S., & Gollan, T. H. (2019). When a seven is not a seven: Self-ratings of bilingual language proficiency differ between and within language populations. Bilingualism: Language and Cognition, 22(3), 516–536. Google Scholar logo with link to Google Scholar
Toribio, A. J. (2001). On the emergence of bilingual code-switching competence. Bilingualism: Language and Cognition, 4(3), 203–231. Google Scholar logo with link to Google Scholar
Treffers-Daller, J., Ongun, Z., Hofweber, J., & Korenar, M. (2020). Explaining individual differences in Executive Functions performance in multilinguals: The impact of code-switching and alternating between Multicultural Identity Styles. Frontiers in Psychology, 11, 561088, 1–20. Google Scholar logo with link to Google Scholar
Tsang, S., Royse, C. F., & Terkawi, A. S. (2017). Guidelines for developing, translating, and validating a questionnaire in perioperative and pain medicine. Saudi Journal of Anesthesia, 111, 80–89. Google Scholar logo with link to Google Scholar
Uribe, M. (2021). Bilingual attitudes towards English-Spanish code-switching in Wyoming. [Unpublished thesis]. University of Wyoming.
U.S. Census. (2015). American Community Survey: Detailed languages spoken at home and ability to speak English for the population 5 years and over: 2009–2013. Retrieved from [URL]
. (2020). Dashboard – United States: Hispanic or Latino percent. Retrieved from [URL]
Valdés Kroff, J., Dussias, P. E., Gerfen, C., Perrotti, L., & Bajo, M. T. (2017). Experience with code-switching modulates the use of grammatical gender during sentence processing. Linguistic Approaches to Bilingualism, 7(2), 163–198. Google Scholar logo with link to Google Scholar
Verreyt, N., Woumans, E., Vandelanotte, D., Szmalec, A., & Duyck, W. (2016). The influence of language switching experience on the bilingual executive control advantage. Bilingualism: Language and Cognition, 19(1), 181–190. Google Scholar logo with link to Google Scholar
Watkins, M. W. (2018). Exploratory factor analysis: A guide to best practice. Journal of Black Psychology, 44(3), 219–246. Google Scholar logo with link to Google Scholar
World Health Organization. (n.d.). Process of translation and adaptation of instruments. World Health Organization. Retrieved March 8, 2020. [URL]
Yim, O., & Bialystok, E. (2012). Degree of conversational code-switching enhances verbal task switching in Cantonese-English bilinguals. Bilingualism, 15(4), 873–888. Google Scholar logo with link to Google Scholar
Zentella, A. C. (1997). Growing up bilingual. Blackwell Publishing.Google Scholar logo with link to Google Scholar
Cited by (17)

Cited by 17 other publications

Awawdeh, Ahmad, Judit Baranyiné Kóczy & Szilvia Bátyi
2025. Pragmatic functions of codeswitching among Maghreb Arabic-French-English trilinguals in a study abroad context. International Journal of Multilingualism ► pp. 1 ff. DOI logo
Callesano, Salvatore, Rodrigo Delgado, Wenyue Ma, Erin Trybulec & Gabriella Reyes
2025. Contextualizing code-switching: testing the effects of reggaetón labels and listening frequency in an Acceptability Judgment Task. Frontiers in Communication 9 DOI logo
Olson, Daniel J. & Lori Czerwionka
2025. The Complementary Principle and language dominance: mapping the language–domain relationships of Spanish–English bilinguals. Multilingua 44:2 ► pp. 205 ff. DOI logo
Russell-Meill, Marissa, Manuel J. Marte, Erin Carpenter & Swathi Kiran
2025. Navigating the Complexity of Bilingual Aphasia: Current Insights and Future Directions. Brain Sciences 15:9 ► pp. 989 ff. DOI logo
Sahana, Kashyap, Srirangam Vijayakumar Narasimhan & Govinda Yashaswini
2025. Adaptation and Validation of the Bilingual Code-Switching Profile Into Kannada. Journal of Speech, Language, and Hearing Research 68:10 ► pp. 4796 ff. DOI logo
Salig, Lauren K., Jorge R. Valdés Kroff, L. Robert Slevc & Jared M. Novick
2025. Hearing a code-switch increases bilinguals’ attention to and memory for information. Journal of Memory and Language 143 ► pp. 104647 ff. DOI logo
Treadway, Hannah, Josh Higdon & Jorge Valdés Kroff
2025. Disentangling grammar and experience. Isogloss. Open Journal of Romance Linguistics 11:4 ► pp. 1 ff. DOI logo
Wu, Ruixue, M. Carmen Parafita Couto & Niels O. Schiller
2025. Variation in gender assignment strategies in mixed Spanish–Chinese noun phrases: Insights from a multilingual community in Barcelona. International Journal of Bilingualism DOI logo
Özkara, Basak, Gülay Cedden, Christiane von Stutterheim & Patric Meyer
2025. Code-switching and cognitive control: a review of current trends and future directions. Frontiers in Language Sciences 4 DOI logo
Gosselin, Leah & Laura Sabourin
2024. Language-specific cognitive flexibility is related to code-switching habits and interactional context; domain-general cognitive flexibility is not. Journal of Cognitive Psychology 36:6 ► pp. 688 ff. DOI logo
Koronkiewicz, Bryan & Rodrigo Delgado
2024. The effect of lexical triggers on Spanish-English code-switched judgment tasks. Frontiers in Psychology 15 DOI logo
Muntendam, Antje & M. Carmen Parafita Couto
2024. Code-Switching at the Interfaces. Languages 9:8 ► pp. 258 ff. DOI logo
Olson, Daniel J. & Yuhyeon Seo
2024. Code-switching experience as a mitigating factor for cross-linguistic phonetic interference. Journal of Phonetics 107 ► pp. 101356 ff. DOI logo
Chen, Hui-Ching & W. Quin Yow
2023. Variability in the effects of bilingualism on task switching of cognitively healthy and cognitively impaired older bilinguals. Frontiers in Language Sciences 2 DOI logo
Olson, Daniel J.
2023. Measuring bilingual language dominance: An examination of the reliability of the Bilingual Language Profile. Language Testing 40:3 ► pp. 521 ff. DOI logo
Olson, Daniel J.
2024. Code-Switching and Language Mode Effects in the Phonetics and Phonology of Bilinguals. In The Cambridge Handbook of Bilingual Phonetics and Phonology, ► pp. 677 ff. DOI logo
Olson, Daniel J.
2025. Bilingual language experience and code-switching acceptability judgments: A constructive replication of the work by Stadthagen-González et al. (2019), Balam et al. (2020), and Stadthagen-González et al. (2018). International Journal of Bilingualism 29:6 ► pp. 1724 ff. DOI logo

This list is based on CrossRef data as of 24 november 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue