In:Digital and Internet-Based Research Methods in Applied Linguistics
Edited by Matt Kessler
[Research Methods in Applied Linguistics 15] 2026
► pp. 289–309
Chapter 14Response time data
Published online: 5 January 2026
https://doi.org/10.1075/rmal.15.14ska
https://doi.org/10.1075/rmal.15.14ska
Abstract
Traditionally the purview of psycholinguistic experiments conducted in controlled laboratory
environments, researchers can now deploy response time tasks such as lexical decision tasks or self-paced reading
paradigms into experiments run on the internet. Data from such tasks are of interest to researchers in applied
linguistics, as these data provide insight into the cognitive representation of language (i.e., the mental lexicon) of
first, second, and additional users of different languages. This chapter first explains what response time data are
and how they are measured, with a particular focus on lexical decision tasks as a core example. Common research
questions associated with response time data are also provided. The chapter then reviews how such tasks are
implemented online, and afterwards, five example studies are reviewed. Finally, the chapter discusses ethical and
practical challenges and considerations for future work in this area.
Article outline
- 1.Introduction
- 2.Frequently asked research questions
- 3.Implementation
- 4.Example studies
- Berger et al. (2019)
- Skalicky et al. (2019)
- Lemhöfer and Broersma (2012)
- Brysbaert et al. (2021)
- Patterson and Nicklin (2023)
- 5.Ethics and research integrity considerations
- 6.Challenges and issues
- 7.Future research directions
Notes References
References (25)
Andringa, S., & Godfroid, A. (2020). Sampling
bias and the problem of generalizability in applied linguistics. Annual Review
of Applied
Linguistics, 40, 134–142.
Balota, D. A., Yap, M. J., Hutchison, K. A., Cortese, M. J., Kessler, B., Loftis, B., Neely, J. H., Nelson, D. L., Simpson, G. B., & Treiman, R. (2007). The
English Lexicon Project. Behavior Research
Methods, 39(3), 445–459.
Barnhoorn, J. S., Haasnoot, E., Bocanegra, B. R., & van Steenbergen, H. (2015). QRTEngine:
An easy solution for running online reaction time experiments using
Qualtrics. Behavior Research
Methods, 47(4), 918–929.
Berger, C. M., Crossley, S. A., & Skalicky, S. (2019). Using
lexical features to investigate second language lexical decision
performance. Studies in Second Language
Acquisition, 41(5), 911–935.
Bridges, D., Pitiot, A., MacAskill, M. R., & Peirce, J. W. (2020). The
timing mega-study: Comparing a range of experiment generators, both lab-based and
online. PeerJ, 8, e9414.
Brysbaert, M., Keuleers, E., & Mandera, P. (2021). Which
words do English non-native speakers know? New supernational levels based on yes/no
decision. Second Language
Research, 37(2), 207–231.
Crossley, S. A., & Skalicky, S. (2017). Making
sense of polysemy relations in first and second language speakers of
English. International Journal of
Bilingualism, 23(2), 400–416.
Elgort, I., & Warren, P. (2022). Studying
second language comprehension. In A. Godfroid & H. Hopp (Eds.), The
Routledge handbook of second language acquisition and
psycholinguistics (pp. 111–123). Routledge.
Ellis, N. C. (2002). Frequency
effects in language processing. Studies in Second Language
Acquisition, 24(02), 143–188.
Ferreira, F., & Yang, Z. (2019). The
problem of comprehension in psycholinguistics. Discourse
Processes, 56(7), 485–495.
Gollan, T. H., Montoya, R. I., Cera, C., & Sandoval, T. C. (2008). More
use almost always means a smaller frequency effect: Aging, bilingualism, and the weaker links
hypothesis. Journal of Memory and
Language, 58(3), 787–814.
Jegerski, J., & VanPatten, B. (2014). Research
methods in second language
psycholinguistics. Routledge.
Lemhöfer, K., & Broersma, M. (2012). Introducing
LexTALE: A quick and valid lexical test for advanced learners of
English. Behavior Research
Methods, 44(2), 325–343.
Liu, H., Bates, E., & Li, P. (1992). Sentence
interpretation in bilingual speakers of English and Chinese. Applied
Psycholinguistics, 13(4), 451–484.
Meyer, D. E., & Schvaneveldt, R. W. (1971). Facilitation
in recognizing pairs of words: Evidence of a dependence between retrieval
operations. Journal of Experimental
Psychology, 90(2), 227–234.
Patterson, A. S., & Nicklin, C. (2023). L2
self-paced reading data collection across three contexts: In-person, online, and
crowdsourcing. Research Methods in Applied
Linguistics, 2(1), 100045.
Puig-Mayenco, E., Chaouch-Orozco, A., Liu, H., & Martín-Villena, F. (2023). The
LexTALE as a measure of L2 global proficiency: A cautionary tale based on a partial replication of Lemhöfer
and Broersma (2012). Linguistic Approaches to
Bilingualism, 13(3), 299–314.
Rodriguez-Cuadrado, S., Hinojosa, J. A., Guasch, M., Romero-Rivas, C., Sabater, L., Suárez-Coalla, P., & Ferré, P. (2022). Subjective
age of acquisition norms for 1604 English words by Spanish L2 speakers of English and their relationship with
lexico-semantic, affective, sociolinguistic and proficiency variables. Behavior
Research
Methods, 55(8), 4437–4454.
Römer, U., Skalicky, S. C., & Ellis, N. C. (2018). Verb-argument
constructions in advanced L2 English learner production: Insights from corpora and verbal fluency
tasks. Corpus Linguistics and Linguistic
Theory, 16(2), 3930331.
Skalicky, S., Crossley, S. A., & Berger, C. M. (2019). Predictors
of second language English lexical recognition: Further insights from a large database of second language
lexical decision times. The Mental
Lexicon, 14(3), 333–356.