Cover not available

In:Research Methods in the Study of L2 Writing Processes
Edited by Rosa M. Manchón and Julio Roca de Larios
[Research Methods in Applied Linguistics 5] 2023
► pp. 161–182

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload Book PDF
EPUB logo with download linkDownload Book EPUB
authorization required

Chapter 8
Using keystroke logging for studying L2 writing processes

 | *Lund University | 1Kristianstad University
 | #University of Gothenburg
 | *Lund University
Published online: 23 October 2023
DOI logo with link
https://doi.org/10.1075/rmal.5.08joh
This chapter presents an overview of keystroke logging. The chapter includes a general rationale for why and when the method is appropriate, how the technique works, and pros and cons with different methodological combinations of keystroke logging. Further, the chapter briefly outlines some previous L2 writing keystroke logging studies to illustrate the type of questions that can be addressed by this data collection technique. Finally, we discuss some methodological challenges and suggest best practices for using the method.
Article outline
  • Introduction
  • Introducing keystroke logging
    • How does keystroke logging work?
  • Research questions addressed in keystroke logging L2 writing studies
    • Research questions focusing on factors moderating pausing behavior
    • Research questions focusing on revision
    • Research questions focusing on writing fluency
    • Research questions with an educational focus
  • Methodological challenges
    • Challenge 1: Choosing hardware
    • Challenge 2: Choosing the keystroke logging program
    • Challenge 3: Choosing settings and procedure
    • Challenge 4: Choosing analyses
    • Challenge 5: Interpreting the findings
  • Best practices
    • Explore writing processes
    • Choose a program that suits your needs
    • Consider orthography
    • Keep variables constant and include baseline tasks
  • Future avenues
  • References
References (49)
References
Abdel Latif, M. M. (2008). A state-of-the-art review of the real-time computer-aided study of the writing process. International Journal of English Studies, 8(1), 29–50. Retrieved on 27 April 2023 from [URL]Google Scholar logo with link to Google Scholar
Alves, R. A., Castro, S. L., de Sousa, L., & Strömqvist, S. (2007). Influence of keyboarding skill on pause- execution cycles in written composition. In M. Torrance, L. Van Waes, & D. Galbraith (Eds.), Writing and cognition: Research and applications (pp. 55–65). Elsevier. Google Scholar logo with link to Google Scholar
Barkaoui, K. (2019). What can L2 writers’ pausing behavior tell us about their L2 writing processes? Studies in Second Language Acquisition, 41, 529–554. Google Scholar logo with link to Google Scholar
Bowen, N. E. J. A., & Thomas, N. (2020). Manipulating texture and cohesion in academic writing: A keystroke logging study. Journal of Second Language Writing, 50. Google Scholar logo with link to Google Scholar
Bowen, N. E. J. A., Thomas, N., & Vandermeulen, N. (2022). Exploring feedback and regulation in online writing classes with keystroke logging. Computers and Composition, 63. Google Scholar logo with link to Google Scholar
Carl, M. (2012). Translog – II: A program for recording user activity data for empirical reading and writing research. InProceedings of the Eight International Conference on Language Resources and Evaluation, European Language Resources Association (ELRA). Retrieved on 27 April 2023 from [URL]
Chenoweth, N. A., & Hayes, J. R. (2001). Fluency in writing: Generating text in L1 and L2. Written Communication, 18, 80–98. Google Scholar logo with link to Google Scholar
Chukharev-Hudalainen, E. (2019). Empowering automated writing evaluation with keystroke logging. In E. Lindgren, Y. Knospe, & K. P. Sullivan (Eds.), Observing writing: insights from keystroke logging and handwriting (pp. 125–142). Brill.Google Scholar logo with link to Google Scholar
Conijn, R., Cook, C., van Zaanen, M., & Van Waes, L. (2022). Early prediction of writing quality using keystroke logging. International Journal of Artificial Intelligence in Education, 32, 835–866. Google Scholar logo with link to Google Scholar
Galbraith, D., & Vedder, I. (2019). Methodological advances in investigating L2 writing processes. Studies in Second Language Acquisition, 41, 633–645. Google Scholar logo with link to Google Scholar
Gunnarsson, C. (2006). Fluidité, complexité et morphosyntaxe dans la production écrite en FLE (Études Romanes de Lund 78, doctoral dissertation). Lund University.
Hayes, J. R., & Flower, L. (1980). Identifying the organisation of the writing process. In L. W. Gregg & E. R. Steinberg (Eds.), Cognitive processes in writing (pp. 3–30). Lawrence Erlbaum Associates.Google Scholar logo with link to Google Scholar
Kellogg, R. T. (1996). A model of working memory in writing. In C. M. Levy & S. E. Ransdell (Eds.), The science of writing (pp. 57–71). Lawrence Erlbaum Associates.Google Scholar logo with link to Google Scholar
Kim, M., Tian, Y. Crossley, S. A. (2021). Exploring the relationships among cognitive and linguistic resources, writing processes, and written products in second language writing. Journal of Second Language Writing, 53. Google Scholar logo with link to Google Scholar
Leijten, M., & Van Waes, L. (2013). Keystroke logging in writing research: Using Inputlog to analyze and visualize writing processes. Written Communication, 30, 358–392. Google Scholar logo with link to Google Scholar
Leijten, M., Van Waes, L., Schriver, K., & Hayes, J. R. (2014). Writing in the work-place: Constructing documents using multiple digital sources. Journal of Writing Research, 5(3), 285–337. Google Scholar logo with link to Google Scholar
Levy, C. M., & Ransdell, S. (1994). Computer-aided protocol analysis of writing processes. Behavior Research Methods, Instruments, & Computers, 26(2), 219–223. Google Scholar logo with link to Google Scholar
Lindgren, E., Spelman Miller, K., & Sullivan, K. P. H. (2008). Development of fluency and revision in L1 and L2 writing in Swedish high school years eight and nine. International Journal of Applied Linguistics, 156, 133–151. Google Scholar logo with link to Google Scholar
Lindgren, E., & Sullivan, K. P. H. (2006). Analysing on-line revision. In K. P. H. Sullivan & E. Lindgren (Eds.), Computer keystroke-logging and writing: Methods and applications (pp. 157–188). Elsevier. Google Scholar logo with link to Google Scholar
Lindgren, E., & Sullivan, K. (Eds.). (2019). Observing writing: Insights from keystroke logging and handwriting. Brill. Google Scholar logo with link to Google Scholar
Lu, X., & Révész, A. (2021). Revising in a non-alphabetic language: The multi-dimensional and dynamic nature of online revisions in Chinese as a second language. System, 100. Google Scholar logo with link to Google Scholar
Lykke Jakobsen, A. (1999). Logging target text production with Translog. In Hansen, G. (Ed.), Probing the process in translation: Methods and results (pp 9–20). Samfundslitteratur.Google Scholar logo with link to Google Scholar
Palviainen, Å., Kalaja, P., & Mäntylä, K. (2012). Development of L2 writing: Fluency and proficiency. AFinLA-E: Soveltavan Kielitieteen Tutkimuksia, 4, 47–59.Google Scholar logo with link to Google Scholar
Ramírez Maraver, R. (2021). L1 and L2 language processing in written production and perception: Null objects in English, Portuguese and Spanish (Unpublished MA thesis), Lund University.
Révész, A., & Michel, M. (2019). State of scholarship. Introduction. Studies in Second Language Acquisition 41, 491–501. Google Scholar logo with link to Google Scholar
Révész, A., Kourtali, N. E., & Mazgutova, D. (2017). Effects of task complexity on L2 writing behaviors and linguistic complexity. Language Learning, 67, 208–241. Google Scholar logo with link to Google Scholar
Severinson Eklundh, K. S., & Kollberg, P. (1992). Translating keystroke records into a general notation for the writing process (IPLab-59). Department of Numerical Analysis and Computing Science, Royal Institute of Technology, Stockholm.Google Scholar logo with link to Google Scholar
Simpson, S., & Torrance, M. (2007). EyeWrite (Version 5.1). Unpublished report, Nottingham Trent University, SR Research.Google Scholar logo with link to Google Scholar
Spelman Miller, K. (2006a). Pausing, productivity and the processing of topic in online writing. In K. P. H. Sullivan & E. Lindgren (Eds.), Computer keystroke logging and writing: Methods and applications (pp. 131–156). Elsevier. Google Scholar logo with link to Google Scholar
(2006b). The pausological study of written language production. In K. P. H. Sullivan & E. Lindgren (Eds.), Computer keystroke logging and writing: Methods and applications (pp. 11–30). Elsevier. Google Scholar logo with link to Google Scholar
Spelman Miller, K., Lindgren, E. & Sullivan. K. P. H. (2008). The psycholinguistic dimension in second language writing: Opportunities for research and pedagogy using computer keystroke logging. TESOL Quarterly, 42(3), 433–454. [URL]. Google Scholar logo with link to Google Scholar
Spelman Miller, K., & Sullivan, K. P. H. (2006). Keystroke logging: An introduction. In K. P. H. Sullivan & E. Lindgren (Eds.), Computer keystroke logging and writing methods and applications (pp. 1–9). Elsevier.Google Scholar logo with link to Google Scholar
Stevenson, M., Schoonen, R., & de Glopper, K. (2006). Revising in two languages: A multi-dimensional comparison of online writing revisions in L1 and FL. Journal of Second Language Writing, 15(3), 201–233. Google Scholar logo with link to Google Scholar
Strömqvist, S., Holmqvist, K., Johansson, V., Karlsson, H., & Wengelin, Å. (2006). What Keystroke logging can reveal about writing. In K. P. H. Sullivan & E. Lindgren (Eds.) Computer keystroke logging: Methods and applications (pp. 45–71). Elsevier. Google Scholar logo with link to Google Scholar
Strömqvist, S., & Karlsson, H. (2001). ScriptLog for windows – User’s manual. Technical report, Department of Linguistics, Lund University and Centre for Reading Research, University College of Stavanger.Google Scholar logo with link to Google Scholar
Strömqvist, S., & Malmsten, L. (1997). Scriptlog Pro 1.04 – user’s manual. Department of Linguistics, University of Gothenburg.Google Scholar logo with link to Google Scholar
Sullivan, K. P. H., & Lindgren, E. (Eds). (2006). Computer keystroke logging and writing: Methods and applications. Elsevier. Google Scholar logo with link to Google Scholar
Thorson, H. (2000). Using the computer to compare foreign- and native-language writing processes: A statistical and case study approach. Modern Language Journal, 84, 55–70. Google Scholar logo with link to Google Scholar
Tiryakioglu, G., Peters, E., Verschaffel, L., Sullivan, K., & Lindgren, E. (2019). The effect of L2 proficiency level on composing processes of EFL learners: Data from keystroke loggings, think alouds and questionnaires. In E. Lindgren & K. Sullivan (Eds.). Observing writing: Insights from keystroke logging and handwriting (pp. 212 – 235). Brill. Google Scholar logo with link to Google Scholar
Usoof, H. A., Leblay, C. & Caporossi, G. 2020. GenoGraphiX-Log version 2.0 user guide, Les Cahiers du GERAD.Google Scholar logo with link to Google Scholar
Vandermeulen, N., Leijten, M., & Van Waes, L. (2020). Reporting writing process feedback in the classroom: Using keystroke logging data to reflect on writing processes. Journal of Writing Research, 12(1), 109–140. Google Scholar logo with link to Google Scholar
Van Waes, L., Leijten, M., Lindgren, E., & Wengelin, Å. (2016). Keystroke logging in writing research. Analyzing online writing processes. In C. A. MacArthur, S. Graham, & J. Fitzgerald (Eds.), Handbook of writing research (pp. 410–426). Guilford Publications.Google Scholar logo with link to Google Scholar
Van Waes, L., Leijten, M., Roeser, J. Olive, T., & Grabowski, J. (2021). Measuring and assessing typing skills in writing research. Journal of Writing Research, 13(1), 107–153. Google Scholar logo with link to Google Scholar
Wengelin, A. (2006). Examining pauses in writing: Theory, methods and empirical data. In K. P. H. Sullivan & E. Lindgren (Eds.), Computer key-stroke logging: Methods and applications (pp. 107–130). Elsevier. Google Scholar logo with link to Google Scholar
Wengelin, Å., Frid, J., Johansson, R., Johansson, V. (2019). Combining keystroke logging with other methods: Towards an experimental environment for writing process research. In E. Lindgren & K. Sullivan (Eds.). Observing writing: Insights from keystroke logging and handwriting (pp. 30–49). Brill.Google Scholar logo with link to Google Scholar
Wengelin, Å., & Johansson, V. (2023). Investigating writing processes with keystroke logging. In O. Kruse, C. Rapp, C. M. Anson, K. Benetos, E. Cotos, A Devitt, & A. Shibani. (Eds.) Digital writing technologies: Impact on theory, research, and practice in higher education. Springer. Google Scholar logo with link to Google Scholar
Xu, C. (2018). Understanding online revisions in L2 writing: A computer keystroke-log perspective. System, 78, 104–114. Google Scholar logo with link to Google Scholar
Xu, C., & Ding, Y. (2014). An exploratory study of pauses in computer-assisted EFL writing. Language Learning & Technology, 18(3), 80–96. [URL]Google Scholar logo with link to Google Scholar
Xu, C., & Qi, Y. (2017). Analyzing pauses in computer-assisted EFL writing: A computer-keystroke-log perspective. Journal of Educational Technology and Society, 20, 24–34. [URL]Google Scholar logo with link to Google Scholar
Cited by (1)

Cited by one other publication

CHEN, Xia & Jackie Xiu YAN
2025. Investigating the processing effort in translation students’ L2 writing and L2 translating: evidence from keylogging. Humanities and Social Sciences Communications 12:1 DOI logo

This list is based on CrossRef data as of 30 november 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue