Cover not available

In:Digital and Internet-Based Research Methods in Applied Linguistics
Edited by Matt Kessler
[Research Methods in Applied Linguistics 15] 2026
► pp. 310–335

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload Book PDF
EPUB logo with download linkDownload Book EPUB
authorization required

Chapter 15
Keystroke logging

 | Arizona State University
 | Vanderbilt University
Published online: 5 January 2026
DOI logo with link
https://doi.org/10.1075/rmal.15.15tia
Abstract
Keystroke logging serves as a non-intrusive method for capturing the temporal dynamics of text production, making it a valuable tool in applied linguistics research. In this chapter, we introduce the technical and practical details involved in implementing web-based keystroke logging for data collection using FlexKeyLogger as an example. We also present some commonly used keystroke measures to operationalize writing behaviors and discuss how these measures align with cognitive processes underlying text composition. We then summarize and review recent studies that leverage keystroke logging to investigate diverse topics in applied linguistics, demonstrating its versatility and research potential. Finally, we address key ethical considerations, challenges associated with keystroke data collection and interpretation, and potential future directions.
Article outline
  • 1.Introduction
  • 2.Frequently asked research questions
  • 3.Implementation
    • Online keystroke logging with FlexKeyLogger
    • Keystroke data preprocessing
    • Keystroke measures
      • Pauses
      • Revision
      • Bursts
    • Cognitive inferences from keystroke measures
    • Keystroke data analysis
  • 4.Example studies
    • Stevenson et al. (2006)
    • Leijten et al. (2019)
    • Chukharev-Hudilainen et al. (2019)
    • Bennett et al. (2020)
    • Vandermeulen et al. (2023)
  • 5.Ethics and research integrity considerations
  • 6.Challenges and issues
  • 7.Future research directions
  • Notes
  • References
References (65)
References
Baaijen, V. M., Galbraith, D., & De Glopper, K. (2012). Keystroke analysis: Reflections on procedures and measures. Written Communication, 29(3), 246–277. Google Scholar logo with link to Google Scholar
Baaijen, V. M., & Galbraith, D. (2018). Discovery through writing: Relationships with writing processes and text quality. Cognition and Instruction, 36(3), 1–25. Google Scholar logo with link to Google Scholar
Bennett, R. E., Zhang, M., Deane, P., & van Rijn, P. W. (2020). How do proficient and less proficient students differ in their composition processes? Educational Assessment, 25(3), 198–217. Google Scholar logo with link to Google Scholar
Bowen, N. E. J. A., Thomas, N., & Vandermeulen, N. (2022). Exploring feedback and regulation in online writing classes with keystroke logging. Computers and Composition, 63, 102692. Google Scholar logo with link to Google Scholar
Breuer, E. O. (2019). Fluency in L1 and FL writing: An analysis of planning, essay writing and final revision. In E. Lindgren & K. P. H. Sullivan (Eds.), Observing writing (pp. 190–211). Brill. Google Scholar logo with link to Google Scholar
Bugl, D. (2019). Learn React Hooks: Build and refactor modern React. js applications using Hooks. Packt Publishing.Google Scholar logo with link to Google Scholar
Carl, M. (2012). Translog-II: A program for recording user activity data for empirical reading and writing research. Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC12), 4108–4112.Google Scholar logo with link to Google Scholar
Chenoweth, N. A., & Hayes, J. R. (2001). Fluency in writing: Generating text in L1 and L2. Written Communication, 18(1), 80–98. Google Scholar logo with link to Google Scholar
(2003). The inner voice in writing. Written Communication, 20(1), 99–118. Google Scholar logo with link to Google Scholar
Choi, I., & Deane, P. (2021). Evaluating writing process features in an adult EFL writing assessment context: A keystroke logging study. Language Assessment Quarterly, 18(2), 107–132. Google Scholar logo with link to Google Scholar
Chukharev-Hudilainen, E. (2019). Empowering automated writing evaluation with keystroke logging. In E. Lindgren & K. P. H. Sullivan (Eds.), Observing writing (pp. 125–142). Brill. Google Scholar logo with link to Google Scholar
Chukharev-Hudilainen, E., Saricaoglu, A., Torrance, M., & Feng, H. H. (2019). Combined deployable keystroke logging and eyetracking for investigating L2 writing fluency. Studies in Second Language Acquisition, 41(3), 583–604. Google Scholar logo with link to Google Scholar
Conijn, R., Cook, C., Van Zaanen, M., & Van Waes, L. (2022). Early prediction of writing quality using keystroke logging. International Journal of Artificial Intelligence in Education, 32(4), 835–866. Google Scholar logo with link to Google Scholar
Conijn, R., Roeser, J., & Van Zaanen, M. (2019). Understanding the keystroke log: The effect of writing task on keystroke features. Reading and Writing, 32(9), 2353–2374. Google Scholar logo with link to Google Scholar
Crossley, S., Tian, Y., Choi, J. S., Holmes, L., & Morris, W. (2024). Plagiarism detection using keystroke logs. Proceedings of the 17th International Conference on Educational Data Mining (EDM), 476–483.Google Scholar logo with link to Google Scholar
Deane, P., & Zhang, M. (2015). Exploring the feasibility of using writing process features to assess text production skills. ETS Research Report Series, 2015(2), 1–16. Google Scholar logo with link to Google Scholar
Galbraith, D., & Baaijen, V. M. (2019). Aligning keystrokes with cognitive processes in writing. In E. Lindgren & K. P. H. Sullivan (Eds.), Observing writing (pp. 306–325). Brill. Google Scholar logo with link to Google Scholar
García, O., & Lin, A. M. (2017). Translanguaging in bilingual education. In O. Garcia, A. M. Y. Lin, & S. May (Eds.), Bilingual and Multilingual Education (pp. 117–130). Springer. Google Scholar logo with link to Google Scholar
Hamel, M. J., & Séror, J. (2016). Video screen capture to document and scaffold the L2 writing process. In C. Caws & M.-J. Hamel (Eds.), Language-learner computer interactions: Theory, methodology, and applications (pp. 137–162). John Benjamins. Google Scholar logo with link to Google Scholar
Hayes, J. R. (2009). From idea to text. In R. Beard, D. Myhill, M. Nystrand, & J. Riley (Eds.), The Sage handbook of writing development (pp. 65–79). Sage. Google Scholar logo with link to Google Scholar
Hayes, J. R., & Flower, L. (1981). Uncovering cognitive processes in writing: An introduction to protocol analysis. ERIC Clearinghouse.Google Scholar logo with link to Google Scholar
Janssen, D., Van Waes, L., & Van den Bergh, H. (2013). Effects of thinking aloud on writing processes. In C. M. Levy & S. Ransdell (Eds.) The science of writing: Theories, individual differences, and applications (pp. 233–250). Routledge.Google Scholar logo with link to Google Scholar
Kaufer, D. S., Hayes, J. R., & Flower, L. (1986). Composing written sentences. Research in the Teaching of English, 20, 121–140. Google Scholar logo with link to Google Scholar
Kellogg, R. T. (1994). The psychology of writing. Oxford University Press.Google Scholar logo with link to Google Scholar
Kuvar, V., Flynn, L., Allen, L., & Mills, C. (2023). Partner keystrokes can predict attentional states during chat-based conversations. Proceedings of the 16th International Conference on Educational Data Mining (EDM), 217–223.Google Scholar logo with link to Google Scholar
Leijten, M., Van Horenbeeck, E., & Van Waes, L. (2019). Analysing keystroke logging data from a linguistic perspective. In E. Lindgren & K. P. H. Sullivan (Eds.), Observing writing (pp.71–95). Brill. Google Scholar logo with link to Google Scholar
Leijten, M., & Van Waes, L. (2020). Designing keystroke logging research in writing studies. Chinese Journal of Second Language Writing, 1(1), 18–39. Google Scholar logo with link to Google Scholar
(2013). Keystroke logging in writing research: Using Inputlog to analyze and visualize writing processes. Written Communication, 30(3), 358–392. Google Scholar logo with link to Google Scholar
Leijten, M., Van Waes, L., & Ransdell, S. (2010). Correcting text production errors: Isolating the effects of writing mode from error span, input mode, and lexicality. Written Communication, 27(2), 189–227. Google Scholar logo with link to Google Scholar
Limpo, T., & Alves, R. A. (2017). Written language bursts mediate the relationship between transcription skills and writing performance. Written Communication, 34(3), 306–332. Google Scholar logo with link to Google Scholar
Lindgren, E., & Sullivan, K. P. H. (2003). Stimulated recall as a trigger for increasing noticing and language awareness in the L2 writing classroom: A case study of two young female writers. Language Awareness, 12, 172–186. Google Scholar logo with link to Google Scholar
Lindgren, E. & Sullivan, K. P. H. (2006). Analyzing on-line revision. In K. P. H. Sullivan, & E. Lindgren (Eds.), Computer keystroke logging: Methods and applications (pp. 157–188). Elsevier. Google Scholar logo with link to Google Scholar
Lindgren, E., & Sullivan, K. P. H. (Eds.). (2019). Observing writing: Insights from keystroke logging and handwriting. Brill. Google Scholar logo with link to Google Scholar
Lindgren, E., Sullivan, K. P. H., & Stevenson, M. (2008). Supporting the reflective language learner with computer keystroke logging. In B. Barber & F. Zhang (Eds.), Handbook of research on computer enhanced language acquisition and learning (pp. 189–204). Information Science Reference, IGI Global. Google Scholar logo with link to Google Scholar
Medimorec, S., & Risko, E. F. (2016). Effects of disfluency in writing. British Journal of Psychology, 107(4), 625–650. Google Scholar logo with link to Google Scholar
Mohsen, M. A. (2024). L1 versus L2 writing processes: What insight can we obtain from a keystroke logging program? Language Teaching Research, 28(6), 2251–2275. Google Scholar logo with link to Google Scholar
Mohsen, M. A., & Qassem, M. (2020). Analyses of L2 learners’ text writing strategy: Process-oriented perspective. Journal of Psycholinguistic Research, 49, 435–451. Google Scholar logo with link to Google Scholar
Perrin, D. (2019). Progression analysis: Working with large data corpora in field research on writing. In E. Lindgren & K. P. H. Sullivan (Eds.), Observing Writing (pp. 143–162). Brill. Google Scholar logo with link to Google Scholar
Révész, A., Kourtali, N. E., & Mazgutova, D. (2017). Effects of task complexity on L2 writing behaviors and linguistic complexity. Language Learning, 67(1), 208–241. Google Scholar logo with link to Google Scholar
Russo, J. E., Johnson, E. J., & Stephens, D. L. (1989). The validity of verbal protocols. Memory & Cognition, 17(6), 759–769. Google Scholar logo with link to Google Scholar
Spelman Miller, K., Lindgren, E., & Sullivan, K. P. (2008). The psycholinguistic dimension in second language writing: Opportunities for research and pedagogy using computer keystroke logging. TESOL Quarterly, 42(3), 433–454. Google Scholar logo with link to Google Scholar
Stevenson, M., Schoonen, R., & De Glopper, K. (2006). Revising in two languages: A multi-dimensional comparison of online writing revisions in L1 and FL. Journal of Second Language Writing, 15(3), 201–233. Google Scholar logo with link to Google Scholar
Strömqvist, S., Holmqvist, K., Johansson, V., Karlsson, H., & Wengelin, A. (2006). What key-logging can reveal about writing. In K. P. H. Sullivan & E. Lindgren (Eds.), Computer keystroke logging and writing: Methods and applications (pp. 45–72). Elsevier. Google Scholar logo with link to Google Scholar
Sullivan, K. P. H., & Lindgren, E. (2002). Self-assessment in autonomous computer-aided L2 writing. ELT Journal, 56(3), 258–266. Google Scholar logo with link to Google Scholar
Thorson, H. (2000). Using the computer to compare foreign and native language writing processes: A statistical and case study approach. Modern Language Journal, 84(ii), 155–170. Google Scholar logo with link to Google Scholar
Tian, Y., Crossley, S., & Van Waes, L. (2025). The KLiCKe corpus: Keystroke logging in compositions for knowledge evaluation. Journal of Writing Research, 17(1), 299–336. Google Scholar logo with link to Google Scholar
Tian, Y., & Cushing, S. T. (2025). Exploring the application of keystroke logging techniques to research in second language (L2) writing. Research Methods in Applied Linguistics, 4(1), 100179. Google Scholar logo with link to Google Scholar
Tian, Y., Kim, M., & Crossley, S. (2024). Making sense of L2 written argumentation with keystroke logging. Journal of Writing Research, 15(3), 435–461. Google Scholar logo with link to Google Scholar
Tian, Y., Kim, M., Crossley, S., & Wan, Q. (2021). Cohesive devices as an indicator of L2 students’ writing fluency. Reading and Writing, 37, 419–441. Google Scholar logo with link to Google Scholar
Tiryakioglu, G., Peters, E., & Verschaffel, L. (2019). The effect of L2 proficiency level on composing processes of EFL learners: Data from keystroke loggings, think alouds and questionnaires. In E. Lindgren & K. P. H. Sullivan (Eds.), Observing writing: Insights from keystroke logging and handwriting (pp. 212–235). Brill. Google Scholar logo with link to Google Scholar
Vandermeulen, N., Leijten, M., & Van Waes, L. (2020). Reporting writing process feedback in the classroom using keystroke logging data to reflect on writing processes. Journal of Writing Research, 12(1), 109–139. Google Scholar logo with link to Google Scholar
Vandermeulen, N., Van Steendam, E., De Maeyer, S., & Rijlaarsdam, G. (2023). Writing process feedback based on keystroke logging and comparison with exemplars: Effects on the quality and process of synthesis texts. Written Communication, 40(1), 90–144. Google Scholar logo with link to Google Scholar
Van den Bergh, H., & Rijlaarsdam, G. (2007). The dynamics of idea generation during writing: An online study. In Ch. 9 of Writing and cognition (pp. 125–150). Brill. Google Scholar logo with link to Google Scholar
Van Waes, L., & Leijten, M. (2015). Fluency in writing: A multidimensional perspective on writing fluency applied to L1 and L2. Computers and Composition, 38, 79–95. Google Scholar logo with link to Google Scholar
Van Waes, L., Leijten, M., Wengelin, A., & Lindgren, E. (2012). Logging tools to study digital writing processes. In V. W. Berninger (Eds.), Past, present, and future contributions of cognitive writing research to cognitive psychology (pp.507–533). Psychology Press. Google Scholar logo with link to Google Scholar
Van Waes, L., & Schellens, P. J. (2003). Writing profiles: The effect of the writing mode on pausing and revision patterns of experienced writers. Journal of Pragmatics, 35(6), 829–853. Google Scholar logo with link to Google Scholar
Van Waes, L., Van Weijen, D., & Leijten, M. (2014). Learning to write in an online writing center: The effect of learning styles on the writing process. Computers & Education, 73, 60–71. Google Scholar logo with link to Google Scholar
Wallot, S., & Grabowski, J. (2019). A tutorial introduction to Recurrence Quantification Analysis (RQA) for key-logging data. In E. Lindgren & K. P. H. Sullivan (Eds.), Observing writing: Insights from keystroke logging and handwriting (pp. 163–189). Brill. Google Scholar logo with link to Google Scholar
Wengelin, Å. (2001). Disfluencies in writing — Are they like in speaking? Proc. ITRW on Disfluency in Spontaneous Speech (DiSS 2001), 85–88.Google Scholar logo with link to Google Scholar
(2002). Text production in adults with reading and writing difficulties. Göteborg University, Department of Linguistics.Google Scholar logo with link to Google Scholar
(2006). Examining pauses in writing: Theories, methods and empirical data. In K. P. H. Sullivan & E. Lindgren (Eds.), Computer key-stroke logging and writing: Methods and applications (pp. 107–130). Elsevier. Google Scholar logo with link to Google Scholar
Wengelin, Å., Frid, J., Johansson, R., & Johansson, V. (2019). Combining keystroke logging with other methods. Towards an experimental environment for writing process research. In E. Lindgren & K. Sullivan (Eds.), Observing writing: Insights from keystroke logging and handwriting (pp. 30–49). Brill. Google Scholar logo with link to Google Scholar
Xu, C., & Xia, J. (2021). Scaffolding process knowledge in L2 writing development: Insights from computer keystroke log and process graph. Computer Assisted Language Learning, 34(4), 583–608. Google Scholar logo with link to Google Scholar
Zhang, M., Guo, H., & Liu, X. (2021). Using keystroke analytics to understand cognitive processes during writing. Proceedings of the 14th International Conference on Educational Data Mining (EMD), 384–390.Google Scholar logo with link to Google Scholar
Zhu, M., Zhang, M., & Gu, L. (2023). Insights into editing and revising in writing process using keystroke logs. Language Assessment Quarterly, 20(4–5), 445–468. Google Scholar logo with link to Google Scholar
Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue