Cover not available

In:Methods in Study Abroad Research: Past, present, and future
Edited by Carmen Pérez-Vidal and Cristina Sanz
[Research Methods in Applied Linguistics 4] 2023
► pp. 33–58

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload Book PDF
EPUB logo with download linkDownload Book EPUB
authorization required

Chapter 2
Quantitative approaches in L2 research abroad

 | Temple University
 | The University of Tennessee, Knoxville
Published online: 3 February 2023
DOI logo with link
https://doi.org/10.1075/rmal.4.02zal
Abstract
This chapter provides an overview and discussion of quantitative research designs that investigate learning outcomes in immersion settings abroad. We begin with a brief introduction to the underlying assumptions, key concepts, and overarching goals of quantitative research approaches for investigating learner development. We then summarize the core contributions of quantitative approaches in study abroad research, with attention to primary study designs, instruments, and measures employed to examine linguistic outcomes, individual differences, and other central aspects of learners’ experiences abroad. This section is followed by a critical discussion of the main methodological limitations associated with this strand of research. Lastly, we propose ways to address these limitations and to achieve more robust and generalizable findings in future quantitative study abroad research.
Article outline
  • Introduction
  • Core contributions of quantitative approaches
    • Types of study design
    • Linguistic outcome measures
    • Global proficiency measures
    • Oral production measures: Complexity, accuracy, and fluency
    • Measures of linguistic knowledge and processing
    • Other tools and measures
    • Individual difference measures
    • Psychosocial factors
    • Linguistic factors
    • Cognitive factors
    • Learner experiences and language contact measures
  • Limitations
    • Methodological design
    • Instruments and operational measures
    • Statistical considerations
  • Strategies and guiding principles for addressing limitations
    • Recommendation 1: Expand within-subjects designs
    • Recommendation 2: Adopt a systematic selection of instruments and measures
    • Recommendation 3: Employ robust and other advanced statistical techniques
    • Recommendation 4: Adopt mixed-methods approaches
  • Conclusion
  • References
References (91)
References
Allen, H. W. (2010). Language-learning motivation during short-term study abroad: An activity theory perspective. Foreign Language Annals, 43, 27–49. Google Scholar logo with link to Google Scholar
Allen, H. W., & Herron, C. (2003). A mixed-methodology investigation of the linguistic and affective outcomes of summer study abroad. Foreign Language Annals, 36, 370–385. Google Scholar logo with link to Google Scholar
Avello, P., & Lara, A. R. (2014). Phonological development in L2 speech production during study abroad programmes differing in length of stay. In C. Pérez-Vidal (Ed.), Language acquisition in study abroad and formal instruction contexts (pp. 137–166). John Benjamins. Google Scholar logo with link to Google Scholar
Baker-Smemoe, W., Dewey, D. P., Bown, J., & Martinsen, R. A. (2014). Variables affecting L2 gains during study abroad. Foreign Language Annals, 47, 464–486. Google Scholar logo with link to Google Scholar
Beattie, J., Valls-Ferrer, M., & Pérez-Vidal, C. (2014). Listening performance and onset level in formal instruction and study abroad. C. Pérez-Vidal (Ed.), Language acquisition in study abroad and formal instruction contexts (pp. 195–216). John Benjamins. Google Scholar logo with link to Google Scholar
Borràs, J., & Llanes, À. (2020). L2 reading and vocabulary development after a short study abroad experience. Vigo International Journal of Applied Linguistics, 17, 35–55. Google Scholar logo with link to Google Scholar
(2019). Re-examining the impact of study abroad on L2 development: A critical overview. The Language Learning Journal, 1–14. Google Scholar logo with link to Google Scholar
Bowden, H. W. (2016). Assessing second-language oral proficiency for research. Studies in Second Language Acquisition, 38, 647–675. Google Scholar logo with link to Google Scholar
Brecht, R., Davidson, D., & Ginsberg, R. B. (1995). Predictors of foreign language gain during study abroad. In B. Freed (Ed.) Second language acquisition in a study abroad context (pp. 37–66). John Benjamins. Google Scholar logo with link to Google Scholar
Bryfonski, L., & Sanz, C. (2018). Opportunities for corrective feedback during study abroad: A mixed methods approach. Annual Review of Applied Linguistics, 38, 1–32. Google Scholar logo with link to Google Scholar
Carroll, J. B., & Sapon, S. M. (1959). Modern Language Aptitude Test. The Psychological Corporation.Google Scholar logo with link to Google Scholar
Cigliana, K. A., & Serrano, R. (2016). Individual differences in US study abroad students in Barcelona. Study Abroad Research in Second Language Acquisition and International Education, 1, 154–185. Google Scholar logo with link to Google Scholar
Collentine, J. (2004). The effects of learning contexts on morphosyntactic and lexical development. Studies in Second Language Acquisition, 26, 227–248. Google Scholar logo with link to Google Scholar
(2009). Study abroad research: Findings, implications and future directions. In C. Doughty & M. Long (Eds.), Handbook of language teaching (pp. 218–233). Blackwell. Google Scholar logo with link to Google Scholar
Collentine, J., & Freed, B. F. (2004). Learning context and its effects on second language acquisition: Introduction. Studies in Second Language Acquisition, 26, 153–171. Google Scholar logo with link to Google Scholar
Costa Jr, P. T., & McCrae, R. R. (1992). Four ways five factors are basic. Personality and Individual Differences, 13, 653–665. Google Scholar logo with link to Google Scholar
Cubillos, J. H., Chieffo, L., & Fan, C. (2008). The impact of short-term study abroad programs on L2 listening comprehension skills. Foreign Language Annals, 41, 157–186. Google Scholar logo with link to Google Scholar
DeKeyser, R. (2010). Monitoring processes in Spanish as a second language during a study abroad program. Foreign Language Annals, 43, 80–92. Google Scholar logo with link to Google Scholar
(2014). Research on language development during study abroad. In C. Pérez-Vidal (Ed.), Language acquisition in study abroad and formal instruction contexts (p. 313–326). John Benjamins. Google Scholar logo with link to Google Scholar
Dewey, D. P. (2004). A comparison of reading development by learners of Japanese in intensive domestic immersion and study abroad contexts. Studies in Second Language Acquisition, 26, 303–327. Google Scholar logo with link to Google Scholar
(2008). Japanese vocabulary acquisition by learners in three contexts. Frontiers: The Interdisciplinary Journal of Study Abroad, 15, 127–148. Google Scholar logo with link to Google Scholar
Du, H. (2013). The development of Chinese fluency during study abroad in China. Modern Language Journal, 97, 131–143. Google Scholar logo with link to Google Scholar
Ely, C. M. (1986). An analysis of discomfort, risk taking, sociability, and motivation in the L2 classroom. Language Learning, 36, 1–25. Google Scholar logo with link to Google Scholar
Evans, M., & Fisher, L. (2005). Measuring gains in pupils’ foreign language competence as a result of participation in a school exchange visit: The case of Y9 pupils at three comprehensive schools in the UK. Language Teaching Research, 9, 173–192. Google Scholar logo with link to Google Scholar
Faretta-Stutenberg, M., & Morgan-Short, K. (2018). Contributions of initial proficiency and language use to second-language development during study abroad: Behavioral and event-related potential evidence. In C. Sanz & A. Morales-Front (Eds.), The Routledge handbook of study abroad research and practice (pp. 421–435). Routledge. Google Scholar logo with link to Google Scholar
Freed, B. F. (1995). What makes us think that students who study abroad become more fluent? In B. F. Freed (Ed.), Second language acquisition in a study abroad context (pp. 123–148). John Benjamins. Google Scholar logo with link to Google Scholar
Freed, B. F., Dewey, D. P., Segalowitz, N., & Halter, R. (2004). The language contact profile. Studies in Second Language Acquisition, 26, 349–356. Google Scholar logo with link to Google Scholar
Freed, B. F., So, S., & Lazar, N. (2003). Language learning abroad: How do gains in written fluency compare with gains in oral fluency in French as a second language? ADL Bulletin, 34, 34–40. Google Scholar logo with link to Google Scholar
García-Amaya, L. (2017). Detailing L1 and L2 use in study-abroad research: Data from the daily linguistic questionnaire. System, 71, 60–72. Google Scholar logo with link to Google Scholar
Gardner, R. C. (1985). The Attitude Motivation Test Battery: Technical report. University of Western Ontario.Google Scholar logo with link to Google Scholar
Golonka, E. M. (2006). Predictors revised: Linguistic knowledge and metalinguistic awareness in second language gain in Russian. Modern Language Journal, 90, 496–505. Google Scholar logo with link to Google Scholar
Grey, S., Cox, J. G., Serafini, E. J., & Sanz, C. (2015). The role of individual differences in the study abroad context: Cognitive capacity and language development during short-term intensive language exposure. Modern Language Journal, 99, 137–157. Google Scholar logo with link to Google Scholar
Han, J. I., Hwang, J. B., & Choi, T. H. (2011). The acquisition of phonetic details: Evidence from the production of English reduced vowels by Korean learners. Second Language Research, 27, 535–557. Google Scholar logo with link to Google Scholar
Hernández, T. A. (2010). The relationship among motivation, interaction, and the development of second language oral proficiency in a study-abroad context. Modern Language Language, 94, 600–617. Google Scholar logo with link to Google Scholar
(2016). Short-term study abroad: Perspectives on speaking gains and language contact. Applied Language Learning, 26, 39–64.Google Scholar logo with link to Google Scholar
Ife, A., Vives Boix, G., & Meara, P. (2000). The impact of study abroad on the vocabulary development of different proficiency groups. Spanish Applied Linguistics, 4, 55–84.Google Scholar logo with link to Google Scholar
Isabelli-García, C., & Lacorte, M. (2016). Language learners’ characteristics, target language use, and linguistic development in a domestic immersion context. Foreign Language Annals, 49(3), 544–556. Google Scholar logo with link to Google Scholar
Issa, B. I., Faretta-Stutenberg, M., & Bowden, H. W. (2020). Grammatical and lexical development during short-term study abroad: Exploring L2 contact and initial proficiency. Modern Language Journal, 104, 860–879. Google Scholar logo with link to Google Scholar
Issa, B., & Zalbidea, J. (2018). Proficiency levels in study abroad: Is there an optimal time for sojourning. In C. Sanz & A. Morales Front (Eds.), The Routledge handbook of study abroad research and practice (pp. 453–463). Routledge. Google Scholar logo with link to Google Scholar
Juan-Garau, M. (2014). Oral accuracy growth after formal instruction and study abroad: Onset level, contact factors and long-term effects. In C. Pérez-Vidal (Ed.), Language acquisition in study abroad and formal instruction contexts. (pp. 87–109). John Benjamins. Google Scholar logo with link to Google Scholar
Kinginger, C. (2008). Language learning in study abroad: Case studies of Americans in France. Modern Language Journal, 92, 1–124. Google Scholar logo with link to Google Scholar
(2011). Enhancing language learning in study abroad. Annual Review of Applied Linguistics, 31, 58–73. Google Scholar logo with link to Google Scholar
LaBrozzi, R. M. (2012). The role of study abroad and inhibitory control on processing redundant cues. In K. Geeslin & M. Díaz-Campos (Eds.), Selected Proceedings of the 14th Hispanic Linguistics Symposium (pp. 228–241). Cascadilla Press. [URL]
Lafford, B. A., & Collentine, J. (2006). The effects of study abroad and classroom contexts on the acquisition of Spanish as a second language. In R. Salaberry & B. A. Lafford (Eds.), The art of teaching Spanish: Second language acquisition from research to praxis (pp. 103–126). Georgetown University Press.Google Scholar logo with link to Google Scholar
LaFlair, G. T., Egbert, J., & Plonsky, L. (2015). A practical guide to bootstrapping descriptive statistics, correlations, t-tests, and ANOVAs. In L. Plonsky (Ed.), Advancing quantitative methods in second language research (pp. 46–77). Routledge. Google Scholar logo with link to Google Scholar
Lambert, C., & Kormos, J. (2014). Complexity, accuracy, and fluency in task-based L2 research: Toward more developmentally based measures of second language acquisition. Applied Linguistics, 35, 607–614. Google Scholar logo with link to Google Scholar
Larson-Hall, J. (2012). Our statistical intuitions may be misleading us: Why we need robust statistics. Language Teaching, 45, 460–474. Google Scholar logo with link to Google Scholar
Larson-Hall, J., Dewey, D. P. (2012). An examination of the effects of input, aptitude, and motivation on language proficiency of missionaries learning Japanese as a second language. In L. Hansen (Ed.), Second language acquisition abroad: The LDS missionary experience (pp. 51–90). John Benjamins. Google Scholar logo with link to Google Scholar
Leonard, K. R., & Shea, C. E. (2017). L2 speaking development during study abroad: Fluency, accuracy, complexity, and underlying cognitive factors. Modern Language Journal, 101, 179–193. Google Scholar logo with link to Google Scholar
Linck, J. A., Kroll, J. F., & Sunderman, G. (2009). Losing access to the native language while immersed in a second language: Evidence for the role of inhibition in second-language learning. Psychological Science, 20, 1507–1515. Google Scholar logo with link to Google Scholar
Llanes, À., & Muñoz, C. (2009). A short stay abroad: Does it make a difference? System, 37, 353–365. Google Scholar logo with link to Google Scholar
Llanes, À., Tragant, E., & Serrano, R. (2012). The role of individual differences in a study abroad experience: The case of Erasmus students. International Journal of Multilingualism, 9, 318–342. Google Scholar logo with link to Google Scholar
Marijuan, S., & Sanz, C. (2018). Expanding boundaries: Current and new directions in study abroad research and practice. Foreign Language Annals, 51, 185–204. Google Scholar logo with link to Google Scholar
Marsden, E. (2020). Methodological transparency in applied linguistics and its consequences for the quality and scope of research. In J. McKinley & H. Rose (Eds.), Routledge handbook of research methods in applied linguistics (pp. 15–28). Routledge. Google Scholar logo with link to Google Scholar
McManus, K., Mitchell, R., & Tracy-Ventura, N. (2021). A longitudinal study of advanced learners’ linguistic development before, during, and after study abroad. Applied Linguistics, 42, 136–163. Google Scholar logo with link to Google Scholar
Meara, P. (2005). LLAMA language aptitude tests: The manual. Lognostics.Google Scholar logo with link to Google Scholar
Mitchell, R. (2021). Documenting L2 input and interaction during study abroad: Approaches, instruments and challenges. Second Language Research. Google Scholar logo with link to Google Scholar
Mitchell, R., Tracy–Ventura, N., & McManus, K. (2017). Anglophone students abroad: Identity, social relationships and language learning. Routledge. Google Scholar logo with link to Google Scholar
Mora, J. C. (2014). The role of onset level on L2 perceptual phonological development after formal instruction and study abroad. In C. Pérez-Vidal (Ed.), Language acquisition in study abroad and formal instruction contexts (p. 167–194). John Benjamins. Google Scholar logo with link to Google Scholar
Muñoz, C., & Llanes, Á. (2014). Study abroad and changes in degree of foreign accent in children and adults. Modern Language Journal, 98, 432–449. Google Scholar logo with link to Google Scholar
Nagle, C., Morales-Front, A., Moorman, C., & Sanz, C. (2016). Disentangling research on study abroad and pronunciation: Methodological and programmatic considerations. In D. Vellarias & D. Coleman-George (Ed.), Handbook of research on study abroad programs and outward mobility (pp. 673–695). IGI Global. Google Scholar logo with link to Google Scholar
Norris, J. M., & Ortega, L. (2009). Towards an organic approach to investigating CAF in instructed SLA: The case of complexity. Applied Linguistics, 30, 555–578. Google Scholar logo with link to Google Scholar
O’Brien, I., Segalowitz, N., Freed, B., & Collentine, J. (2007). Phonological memory predicts second language oral fluency gains in adults. Studies in Second Language Acquisition, 29, 557–581. Google Scholar logo with link to Google Scholar
Ortega, L. (2013). SLA for the 21st century: Disciplinary progress, transdisciplinary relevance, and the bi/multilingual turn. Language Learning, 63, 1–24. Google Scholar logo with link to Google Scholar
Pérez-Vidal, C., Juan-Garau, M., & Mora, J. C. (2010). The effects of formal instruction and study abroad contexts on foreign language development: The SALA project. In C. Sanz & R. P. Leow (Eds.), Implicit and explicit language learning: Conditions, processes and knowledge in SLA and bilingualism (p. 194–215). Georgetown University Press. Google Scholar logo with link to Google Scholar
Plonsky, L. (2015). Statistical power, p values, descriptive statistics, and effect sizes: A “back-to-basics” approach to advancing quantitative methods in L2 research. In L. Plonsky (Ed.), Advancing quantitative methods in second language research (pp. 23–45). Routledge. Google Scholar logo with link to Google Scholar
Plonsky, L., & Oswald, F. L. (2014). How big is “big”? Interpreting effect sizes in L2 research. Language Learning, 64, 878–912. Google Scholar logo with link to Google Scholar
Purpura, J. E., Brown, J. D., & Schoonen, R. (2015). Improving the validity of quantitative measures in applied linguistics research. Language Learning, 65, 37–75. Google Scholar logo with link to Google Scholar
Sagarra, N., & LaBrozzi, R. (2018). Benefits of study abroad on L2 morphosyntactic processing and working memory on L2 semantic processing. In C. Sanz & A. Morales-Front (Eds.), The Routledge handbook of study abroad research and practice. Routledge. Google Scholar logo with link to Google Scholar
Sanz, C. (2014). Contribution of study abroad research to our understanding of SLA processes and outcomes: The SALA project, an appraisal. In C. Pérez-Vidal (Ed.), Language acqui- sition in study abroad and formal instruction contexts (pp. 1–17). John Benjamins. Google Scholar logo with link to Google Scholar
Sanz, C., & Grey, S. (2015). Effects of conditions on L2 development: Moving beyond accuracy. In P. Rebuschat (Ed.), Implicit and explicit learning of languages (pp. 301–324). John Benjamins. Google Scholar logo with link to Google Scholar
Sasaki, M. (2011). Effects of varying lengths of study-abroad experiences on Japanese EFL students’ L2 writing ability and motivation: A longitudinal study. TESOL Quarterly, 45, 81–105. Google Scholar logo with link to Google Scholar
Segalowitz, N., & Freed, B. F. (2004). Context, contact, and cognition in oral fluency acquisition: Learning Spanish in at home and study abroad contexts. Studies in Second Language Acquisition, 26, 173–199. Google Scholar logo with link to Google Scholar
Serrano, R., & Llanes, À. (2015). An exploratory study of the role of age and language learning aptitude in a short stay abroad. Vigo International Journal of Applied Linguistics, 2015, 12, 107–126.Google Scholar logo with link to Google Scholar
Serrano, R., Llanes, À., & Tragant, E. (2011). Analyzing the effect of context of second language learning: Domestic intensive and semi-intensive courses vs. study abroad in Europe. System, 39, 133–143. Google Scholar logo with link to Google Scholar
Serrano, R., Tragant, E., & Llanes, À. (2012). A longitudinal analysis of the effects of one year abroad. Canadian Modern Language Review, 68, 138–163. Google Scholar logo with link to Google Scholar
Shively, R. L. (2011). L2 pragmatic development in study abroad: A longitudinal study of Spanish service encounters. Journal of Pragmatics, 43, 1818–1835. Google Scholar logo with link to Google Scholar
Sunderman, G., & Kroll, J. F. (2009). When study abroad experience fails to deliver: The internal resources threshold effect. Applied Psycholinguistics, 30, 79–99. Google Scholar logo with link to Google Scholar
Taguchi, N. (2008). Cognition, language contact, and the development of pragmatic comprehension in a study-abroad context. Language Learning, 58, 33–71. Google Scholar logo with link to Google Scholar
Tokowicz, N., Michael, E. B., & Kroll, J. F. (2004). The roles of study-abroad experience and working-memory capacity in the types of errors made during translation. Bilingualism Language and Cognition, 7, 255–272. Google Scholar logo with link to Google Scholar
Tullock, B., & Ortega, L. (2017). Fluency and multilingualism in study abroad: Lessons from a scoping review. System, 71, 7–21. Google Scholar logo with link to Google Scholar
Vallejos, C., & Sanz, C. (2021). Writing in study abroad contexts. In R. M. Manchón & C. Polio (Eds.), The Routledge handbook of second language acquisition and writing. Routledge. Google Scholar logo with link to Google Scholar
Valls-Ferrer, M., & Mora, J. C. (2014). L2 fluency development in formal instruction and study abroad: The role of initial fluency level and language contacts. In C. Pérez-Vidal (Ed.), Language acquisition in study abroad and formal instruction contexts (pp. 111–136). John Benjamins. Google Scholar logo with link to Google Scholar
Vande Berg, M., Connor-Linton, J., & Paige, R. M. (2009). The Georgetown consortium project: Interventions for student learning abroad. Frontiers: The Interdisciplinary Journal of Study Abroad, 18, 1–75. Google Scholar logo with link to Google Scholar
Van de Schoot, R., & Milica, M. (2020). Small sample size solutions: A guide for applied researchers and practitioners. Routledge. Google Scholar logo with link to Google Scholar
Van Oudenhoven, J. P., & Van der Zee, K. I. (2002). Predicting multicultural effectiveness of international students: The Multicultural Personality Questionnaire. International Journal of Intercultural Relations, 26, 679–694. Google Scholar logo with link to Google Scholar
Zalbidea, J., Issa, B. I., Faretta-Stutenberg, M., & Sanz, C. (2021). Initial proficiency and L2 grammar development during short-term immersion abroad: Conceptual and methodological insights. Studies in Second Language Acquisition, 43, 239–267. Google Scholar logo with link to Google Scholar
Zalbidea, J., Issa, B., & Faretta-Stutenberg, M. (2022). ‘Brief but mighty’? Sustained L2 learning and perceived psychobehavioral benefits after short-term study abroad. Modern Language Journal, 106, 411–428. Google Scholar logo with link to Google Scholar
Zaytseva, V., Miralpeix, I., & Pérez-Vidal, C. (2019). ESL written development at home and abroad: Taking a closer look at vocabulary. International Journal of Bilingual Education and Bilingualism. Google Scholar logo with link to Google Scholar
Cited by (1)

Cited by one other publication

Fernández, Julieta & Rachel Shively
2025. Methodologies in Spanish-language study abroad research. Journal of Spanish Language Teaching 12:2 ► pp. 123 ff. DOI logo

This list is based on CrossRef data as of 30 november 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue