In:Technology and Instructed Second Language Acquisition: Connecting research and pedagogy
Edited by Shawn Loewen, Frederick J. Poole, Hyun-Bin Hwang and Matthew D. Coss
[Language Learning & Language Teaching 63] 2025
► pp. 16–44
Chapter 1Is technology research ready to inform L2 pedagogy?
A systematic evaluation of practitioner relevance in CALL-ISLA research
Published online: 27 October 2025
https://doi.org/10.1075/lllt.63.01hwa
https://doi.org/10.1075/lllt.63.01hwa
Abstract
In this chapter, we systematically examine studies at the intersection of CALL and ISLA, aiming to
determine how effectively these studies support L2 practitioners in making informed decisions about using technology in their
classrooms. Our review, which includes 105 studies from four major CALL journals, assesses their practical relevance by
focusing on transferability, informativeness, and implementability. Notably, we found that CALL-ISLA research has
predominantly centered on adult L2 learners of English, yet only a small portion of CALL-ISLA studies offer actionable
insights for L2 pedagogy. Additionally, many studies use technology that requires considerable effort from practitioners to
integrate it into their everyday practices. Consequently, CALL-ISLA research makes limited contributions to L2 practice. Based
on our findings, we advocate for more practitioner-responsive research. Ultimately, we suggest that CALL-ISLA studies should
be more informed by L2 practitioners’ pedagogical concerns and contexts to enhance practical relevance of CALL-ISLA study to
classrooms.
Article outline
- Introduction
- To what extent is pedagogy foregrounded in CALL-ISLA research?
- Conceptualizing practitioner relevance
- Transferability
- Informativeness
- Implementability
- Goals of the study
- Method
- Study inclusion
- Data coding
- PI Informativeness
- Implementability
- Analysis
- Results
- RQ1: How transferable are the findings of recent CALL-ISLA research?
- RQ2: How practical is the implementation of recent CALL-ISLA research?
- RQ3: How informative are the pedagogical implications of recent CALL-ISLA research?
- RQ4: What emergent patterns can be found among features related to practitioner relevance in recent CALL-ISLA research?
- Reflections on the current state of CALL-ISLA research
- Towards practitioner-responsive CALL-ISLA research
- Suggestions for increased relevance of CALL-ISLA research
- Conclusion
- Generative AI use acknowledgement
Acknowledgements Note References
References (48)
Berliner, D. C. (2002). Educational
research: The hardest science of all. Educational
Researcher, 31(8), 18–20.
Burston, J., Athanasiou, A., & Giannakou, K. (2024). Quantitative
experimental L2 acquisition MALL studies: A critical evaluation of research
quality. ReCALL, 36(1), 22–39.
Chi, C., Chen, H.-J. H., Tseng, W.-T., Liu, Y.-T. (2023). Efficacy
of different presentation modes for L2 video comprehension: Full versus partial display of verbal and nonverbal
input. ReCALL, 35(1), 105–121.
Cornillie, F. (2024, May 23). It
takes a village to create impact from research: Towards smart collaboration within the innovation ecosystem of
CALL [Plenary address]. Computer Assisted Language Instruction
Consortium (CALICO) Conference, Pittsburgh, PA.
Coss, M. D., & Hwang, H.-B. (2024). Issues
with pedagogical implications in applied linguistics research: A mixed-methods systematic
evaluation. Research Methods in Applied
Linguistics, 3, 100094.
(2025). Improving
pedagogical implications in applied linguistics research: Evidence and action items from a systematic multi-journal
analysis. Studies in Second Language Learning and
Teaching. Advance online publication.
Crowther, D., Kim, S., Lee, J., Lim, J., & Loewen, S. (2021). Methodological
synthesis of cluster analysis in second language research. Language
Learning, 71(1), 99–130.
Dai, Y., & Wu, Z. (2023). Mobile-assisted
pronunciation learning with feedback from peers and/or automatic speech recognition: A mixed-methods
study. Computer Assisted Language
Learning, 36(5–6), 861–884.
De Costa, P. I., Randez, R. A., Cinaglia, C., & Montgomery, D. P. (2022). Qualitative
ISLA research methodologies and methods. In L. Gurzynski-Weiss & Y. Kim (Eds.). Instructed
second language acquisition research
methods (pp. 55–78). John Benjamins.
DeKeyser, R., & Botana, G. P. (2019). Current
research on instructed second language learning: A bird’s eye
view. In R. DeKeyser & G. P. Botana (Eds.), Doing
SLA research with implications for the classroom: Reconciling methodological demands and pedagogical
applicability (pp. 1–7). John Benjamins.
García, C., Nickolai, D., & Jones, L. (2020). Traditional
versus ASR-based pronunciation instruction: An empirical study. CALICO
Journal, 37(3), 213–232.
Godfroid, A., & Andringa, S. (2023). Uncovering
sampling biases, Advancing inclusivity, and rethinking theoretical accounts in second language acquisition:
Introduction to the special issue SLA for All? Language
Learning, 73(4), 981–1002.
González-Lloret, M. (2023). The
road System travelled: Five decades of technology in language
education. System, 118, 103124.
Gutiérrez, K. D., & Penuel, W. R. (2014). Relevance
to practice as a criterion for rigor. Educational
researcher, 43(1), 19–23.
Hamilton, E. R., Rosenberg, J., & Akcaoglu, M. (2016). The
substitution augmentation modification redefinition (SAMR) model: A critical review and suggestions for its
use. TechTrends, 60, 433–441.
Han, Z. (2007). Pedagogical
implications: Genuine or pretentious? TESOL
Quarterly, 41(2), 387–393. [URL].
Hiver, P., & Al-Hoorie, A. H. (2019). Research
methods for complexity theory in applied linguistics. Multilingual Matters.
Hwang, H.-B. (2023). Is
evidence-based L2 pedagogy achievable? The research–practice dialogue in grammar
instruction. Modern Language
Journal, 107(3), 734–755.
Hwang, H.-B., Coss, M. D., Sato, M., Cárcamo, B., Nguyen, M. X. N. C., Dao, P., Iwashita, N., Marsden, E., Hawkes, R., Loewen, S., Scheffler, P., Baranowska, K., McKinley, J., & Ortega, L. (2024). (Re)Examining
the research–practice interface: International perspectives, multiple methods, persistent challenges, and novel
directions. Language Teaching. Advance online
publication.
Kern, R. (2024). Twenty-first
century technologies and language education: Charting a path forward. Modern Language
Journal, 108, 515–533.
Kim, Y., & Namkung, Y. (2024). Methodological
characteristics in technology-mediated task-based language teaching research: Current practices and future
directions. Annual Review of Applied Linguistics. Advance
online publication.
Lee, S.-M. (2023). The
effectiveness of machine translation in foreign language education: A systematic review and
meta-analysis. Computer Assisted Language
Learning, 36(1–2), 103–125.
Li, Y., Hafner, C. A. (2022). Mobile-assisted
vocabulary learning: Investigating receptive and productive vocabulary knowledge of Chinese EFL
learners. ReCALL, 34(1), 66–80.
Lightbown, P. (2000). Classroom
SLA research and second language teaching. Applied
Linguistics, 21(4), 431–462.
Łodzikowski, K. (2021). Association
between allophonic transcription tool use and phonological awareness level. Language
Learning &
Technology, 25(1), 20–30. [URL]
Mackey, A. (2017). Classroom-based
research. In S. Loewen & M. Sato (Eds.), The
Routledge handbook of instructed second language
Acquisition. Routledge.
Maie, R., & Godfroid, A. (2024). A
synthesis of L2 practice research: What is “practice” and how has it been
investigated? In Y. Suzuki (Ed.), Practice
and automatization in second language research: Perspective from skill acquisition theory and cognitive
psychology (pp. 181–205). Routledge.
Martin, I. A. (2020). Pronunciation
development and instruction in distance language learning. Language Learning &
Technology, 24(1), 86–106.
(2023). Motivation
in computer-assisted pronunciation training: Online and face-to-face
environments. Language Learning &
Technology, 27(1), 1–21. [URL]
Medina González, M., & Hardison, D. M. (2022). Assistive
design for English phonetic tools (ADEPT) in language learning. Language Learning &
Technology, 26(1), 1–23. [URL]
Mohsen, M. A., Althebi, S., Alsagour, R., Alsalem, A., Almudawi, A., & Alshahrani, A. (2023). Forty-two
years of computer-assisted language learning research: A scientometric study of hotspot research and trending
issues. ReCALL. Advance online
publication.
Plonsky, L. (2023). Sampling
and generalizability in Lx research: A second-order
synthesis. Languages, 8(1), 75.
(2024). Study
quality as an intellectual and ethical imperative: A proposed framework. Annual Review
of Applied Linguistics. Advance online publication.
Sato, M., & Loewen, S. (2022). The
research-practice dialogue in second language learning and teaching: Past, present, and
future. Modern Language
Journal, 106(3), 509–527.
Sauro, S., & Chapelle, C. A. (2017). Toward
langua-technocultural competence. In C. A. Chapelle & S. Sauro (Eds.)., The
handbook of technology and second language teaching and learning. John Wiley & Sons.
Seyyedrezaei, M. S., Amiryousefi, M., Gimeno-Sanz, A., & Tavakoli, M. (2023). A
meta-analysis of the relative effectiveness of technology-enhanced language learning on ESL/EFL writing performance:
Retrospect and prospect. Computer Assisted Language
Learning. Advance online publication.
Shadiev, R., Wu, T.-T., & Huang, Y.-M. (2020). Using
image-to-text recognition technology to facilitate vocabulary acquisition in authentic
contexts. ReCALL, 32(2), 195–212.
Sydorenko, T., Arnold, N. & Thorne, S. (2025). Augmented
and virtual reality for L2 learning. In S. Loewen, F. Poole, H. -B. Hwang, & M. D. Coss (Eds.), Technology
and instructed second language acquisition: Connecting research and pedagogy (pp.
228–252). John Benjamins.
Van Lieshout, C., & Cardoso, W. (2022). Google
Translate as a tool for self-directed language learning. Language Learning &
Technology, 26(1), 1–19. [URL]
Wang, Y. (2019). Effects
of L1/L2 captioned TV programs on students’ vocabulary learning and
comprehension. CALICO
Journal, 36(3), 204–224.
Xu, Y.-J., Chiou, S.-C., & You, M. (2020). Effects
of improving the interactive design of a Chinese character learning system on the learning performance of Chinese as
foreign language students. Computer Assisted Language
Learning, 33(8), 916–935.
Yamashita, T. (2019). The
comparative effects of metalinguistic clue and metalinguistic explanation in computer-mediated form-focused practice:
Does prior knowledge matter? Computer Assisted Language
Learning, 32(1–2), 98–117.
(2021). Corrective
feedback in computer-mediated collaborative writing and revision
contributions. Language Learning &
Technology, 25(2), 75–93. [URL]
Yeh, H.-C., & Tseng, S.-S. (2020). Enhancing
multimodal literacy using augmented reality. Language Learning &
Technology, 24(1), 27–37.
Cited by (4)
Cited by four other publications
Buendgens-Kosten, Jules & Carolyn Blume
2025. Of barriers and bias. In Technology and Instructed Second Language Acquisition [Language Learning & Language Teaching, 63], ► pp. 45 ff.
Godwin-Jones, Robert
2025. Afterword: Towards sustainable technology use in instructed second language acquisition. In Technology and Instructed Second Language Acquisition [Language Learning & Language Teaching, 63], ► pp. 335 ff.
Hwang, Hyun‐Bin & Matthew D. Coss
Quinn, Shannon Donnally & Irina Zaykovskaya
2025. Instructed SLA and instructional design principles. In Technology and Instructed Second Language Acquisition [Language Learning & Language Teaching, 63], ► pp. 68 ff.
This list is based on CrossRef data as of 29 november 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.
