In:Research Methods in the Study of L2 Writing Processes
Edited by Rosa M. Manchón and Julio Roca de Larios
[Research Methods in Applied Linguistics 5] 2023
► pp. 183–200
Chapter 9Using eye tracking to study digital writing processes
Published online: 23 October 2023
https://doi.org/10.1075/rmal.5.09joh
https://doi.org/10.1075/rmal.5.09joh
This chapter presents an overview of eye tracking
combined with tools for capturing digital writing (foremost keystroke
logging). This includes a general rationale for why eye tracking is relevant
for research on writing processes, how the technique works, and pros and
cons of different eye trackers and methodological designs. The chapter
describes previous L1 and L2 writing studies which have used eye tracking to
illustrate the type of questions that can be addressed by this technique.
Finally, some methodological challenges are highlighted and best practices
are suggested. It is emphasized that information of writers’ visual
attention can enrich real-time writing studies, but that the researcher must
pose research questions and opt for designs bearing in mind the advantages
and limitations of the technique.
Article outline
- Introduction
- Introducing eye tracking technology
- How does eye tracking work?
- Eye tracking and writing research
- Research questions addressed in eye tracking writing studies
- Theoretical frameworks as a source for research questions
- Research questions addressing reading during writing
- Methodological challenges
- Challenge 1: Choosing eye tracker for your purpose
- Challenge 2: Compensating for the dynamic writer and the dynamic text
- Challenge 3: Choosing method for capturing writing processes
- Challenge 4: Asking questions and drawing conclusions from eye tracking studies
- Best practices in using eye tracking in writing studies
- Future avenues
Notes References
References (54)
Alamargot, D., Caporossi, G., Chesnet, D., & Ros, C. (2011). What
makes a skilled writer? Working memory and audience awareness during
text composition. Learning and
Individual
Differences 21, 505–516.
Alamargot, D., Chesnet, D., Dansac, C., & Ros, C. (2006). Eye
and pen: A new device for studying reading during
writing. Behavior Research Methods,
Instruments, &
Computers, 38(2), 287–299.
Alves, F., Pagano, A., & Da Silva, I. (2010). A
new window on translator’s cognitive activity: Methodological issues
in the combined use of eye tracking, key logging and retrospective
protocols. In I. Mees, F. Alves, & S. Göpferich (Eds.), Methodology,
technology and innovation in translation process
research (pp. 267–292). Samfundslitteratur.
Andersson, B., Dahl, J., Holmqvist, K., Holsanova, J., Johansson, V., Karlsson, H., Strömqvist, S., Tufvesson, S., & Wengelin, Å. (2006). Combining
keystroke logging with eye
tracking. In L. Van Waes, M. Leijten, & C. Neuwirth (Eds.), Writing
and digital
media (pp. 166–172). Elsevier.
Barkaoui, K. (2019). What
can L2 writers’ pausing behavior tell us about their L2 writing
processes? Studies in Second Language
Acquisition, 41, 529–554.
Beers, S. F., Quinlan, T., & Harbaugh, A. G. (2010). Adolescent
students’ reading during writing behaviors and relationships with
text quality: An eyetracking
study. Reading and
Writing, 23, 743–775.
Chukharev-Hudilainen, E., Saricaoglu, A., Torrance, M., & Feng, H. (2019). Combined
deployable keystroke logging and eyetracking for investigating L2
writing fluency. Studies in Second
Language
Acquisition, 41(3), 583–604.
Conklin, K., & Pellicer-Sánchez, A. (2016). Using
eye- tracking in applied linguistics and second language
research. Second Language
Research, 32(3), 453–467.
Conklin, K., Pellicer-Sánchez, A., & Carrol, G. (2018). Eye
tracking: A guide for applied linguistics
research. Cambridge University Press.
De Smet, M. J. R., Leijten, M., & Van Waes, L. (2018). Exploring
the process of reading during writing using eye tracking and
keystroke logging. Written
Communication, 35(4), 411–447.
Drijbooms, E., Groen, M. A., Alamargot, D., & Verhoeven, L. (2019). Online
management of text production from pictures: A comparison between
fifth graders and undergraduate
students. Psychological
Research, 84, 2311–2324.
Engbert, R., Longtin, A., & Kliegl, R. (2002). A
dynamical model of saccade generation in reading based on spatially
distributed lexical
processing. Vision
Research, 42(5), 621–636.
Galbraith, D., & Vedder, I. (2019). Methodological
advances in investigating L2 writing
processes. Studies in Second Language
Acquisition 41, 633–645.
Gánem-Gutiérrez, G. A., & Gilmore, A. (2018). Tracking
the real-time evolution of a writing event: Second language writers
at different proficiency
levels. Language
Learning, 68, 469–506.
Godfroid, A., & Hui, B. (2020). Five
common pitfalls in eye tracking
research. Second Language
Research, 36(3), 277–305.
Godfroid, A., & Spino, L. A. (2015). Reconceptualizing
reactivity of think-alouds and eye tracking: Absence of evidence is
not evidence of absence. Language
Learning, 65(4), 896–928.
Godfroid, A., Winke, P., & Conklin, K. (2020). Exploring
the depths of second language processing with eye tracking: An
introduction. Second Language
Research, 36(3), 243–255.
Hacker, D. J., Keener, M. C., & Kircher, J. C. (2017). TRAKTEXT:
Investigating writing processes using eye-tracking
technology. Methodological
Innovations, 10(2), 1–18.
Hayes, J. R. (1996). A
new framework for understanding cognition and affect in
writing. In C. M. Levy & S. E. Ransdell (Eds.), The
science of writing: Theories, methods, individual differences, and
applications (pp. 1–27). Lawrence Erlbaum Associates.
Hayes, J. R., & Flower, L. (1980). Identifying
the organisation of the writing
process. In L. W. Gregg & E. R. Steinberg (Eds.), Cognitive
processes in
writing (pp. 3–30). Lawrence Erlbaum Associates.
Holmqvist, K., Holsanova, J., Johansson V. & Strömqvist, S. (2004). Perceiving
and producing the Frog
Story. In D. Ravid & H. Bat-Zeev Shyldkrot (Eds.), Perspectives
on language and language development. Essays in honor of Ruth A.
Berman (pp. 293–306). Kluwer.
Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., & Van de Weijer, J. (2011). Eye
tracking: A comprehensive guide to methods and
measures. Oxford University Press.
Holmqvist, K., Nyström, M., & Mulvey, F. (2012). Eye
tracker data quality: What it is and how to measure
it. Proceedings of the Symposium on
Eye Tracking Research and
Applications (pp. 45–52).
Johansson, R., Wengelin, Å., Johansson, V., & Holmqvist, K. (2010). Looking
at the keyboard or the monitor: Relationship with text production
processes. Reading and
Writing, 23(7), 835–851.
Just, M. A., & Carpenter, P. A. (1980). A
theory of reading: From eye fixations to
comprehension. Psychological
Review 87, 329–54.
Kellogg, R. T. (1996). A
model of working memory in
writing. In C. M. Levy & S. E. Ransdell (Eds.), The
science of
writing (pp. 57–71). Lawrence Erlbaum Associates.
Larsson, L., Nyström, M., Andersson, R., & Stridh, M. (2015). Detection
of fixations and smooth pursuit movements in high-speed eye tracking
data. Biomedical Signal Processing
and
Control, 18, 145–152.
Leijten, M., & Van Waes, L. (2013). Keystroke
logging in writing research: Using Inputlog to analyze and visualize
writing processes. Written
Communication, 30, 358–392.
Leijten, M., Van Waes, L., Schrijver, I., Bernolet, S., & Vangehuchten, L. (2019). Mapping
master’s students’ use of external sources in source-based writing
in L1 and L2. Studies in Second
Language
Acquisition, 41, 555–582.
Leijten, M., Van Waes, L., Schriver, K., & Hayes, J. R. (2014). Writing
in the work-place: Constructing documents using multiple digital
sources. Journal of Writing
Research, 5(3), 285–337.
Lindgren, E., & Sullivan, K. (Eds.). (2019). Observing
writing: Insights from keystroke logging and
handwriting. Brill.
Manchón, R. M., Roca de Larios, J., & Murphy, L. (2000). An
approximation to the study of backtracking in L2
writing. Learning and
Instruction, 10(1), 13–35.
Matsuhashi, A. (1981). Pausing
and planning: The tempo of written discourse
production. Research in the Teaching
of
English, 15, 113–134. [URL]
Michel, M. Révész, A., Lu, X, Kourtali, N. -E., Lee, M. & Borges, L. (2020). Investigating
L2 writing processes across independent and integrated tasks: A
mixed-methods study. Second Language
Research, 36(3), 307–334.
Nottbusch, G. (2010). Grammatical
planning, execution, and control in written sentence
production. Reading and
Writing, 23(7), 777–801.
Posner, M. I. (1980). Orienting
of attention. Quarterly Journal of
Experimental
Psychology, 32, 3–25.
Rayner, K. (1998). Eye
movements in reading and information processing: 20 years of
research. Psychological
Bulletin, 124(3), 372–422.
Rayner, K., Pollatsek, A., Ashby, J., & Clifton Jr., C. (2012). The
psychology of reading. Psychology Press.
Révész, A., & Michel, M. (2019). Introduction
to the special issue. Studies in
Second Language
Acquisition, 41, 491–501.
Révész, A., Michel, M., & Lee, M. (2017). Investigating
IELTS Academic Writing Task 2: Relationships between
cognitive writing processes, text quality, and working
memory. British Council, Cambridge English Language Assessment and IDP.
(2019). Exploring
second language writers’ pausing and revision behaviors: A
mixed-methods study. Studies in
Second Language
Acquisition, 41(3), 605–631.
Semmelmann, K., & Weigelt, S. (2018). Online
webcam-based eye tracking in cognitive science: A first
look. Behavior Research
Methods, 50(2), 451–465.
Shintani, N., & Ellis, R. (2013). The
comparative effect of direct written corrective feedback and
metalinguistic explanation on learners’ explicit and implicit
knowledge of the English indefinite
article. Journal of Second Language
Writing, 22(3), 286–306.
Simpson, S., & Torrance, M. (2007). EyeWrite (Version
5.1). Unpublished
report, Nottingham Trent University,
SR Research.
Smith, B. (2012). Eye
tracking as a measure of noticing: A study of explicit recasts in
SCMC. Language Learning &
Technology, 16(3), 53–81. [URL]
Spelman Miller, K., Lindgren, E. & Sullivan. K. P. H. (2008). The
psycholinguistic dimension in second language writing: Opportunities
for research and pedagogy using computer keystroke
logging. TESOL
Quarterly, 42(3), 433–454.
Torrance, M., Johansson, R., Johansson, V., & Wengelin, Å. (2016). Reading
during the composition of multi-sentence texts: An eye-movement
study. Psychological
Research, 80, 729–743.
Torrance, M., & Nottbusch, G. (2012). Written
production of single words and simple
sentences. In V.W. Berninger (Ed.), Past,
present, and future contributions of cognitive writing research to
cognitive psychology. Psychology Press.
Van Waes, L., Leijten, M., & Quinlan, T. (2010). Reading
during sentence composing and error correction: A multilevel
analysis of the influences of task
complexity. Reading and
Writing, 23(7), 803–834.
Van Waes, L., Leijten, M., Roeser, J. Olive, T., & Grabowski, J. (2021). Measuring
and assessing typing skills in writing
research. Journal of Writing
Research, 13(1), 107–153.
Wengelin, Å., Frid, J., Johansson, R., & Johansson, V. (2019). Combining
keystroke logging with other methods: Towards an experimental
environment for writing process
research. In E. Lindgren & K. Sullivan (Eds.), Observing
writing: Insights from keystroke logging and
handwriting (pp. 30–49). Brill.
Wengelin, Å., Johansson, R., & Johansson, V. (2014). Expressive
writing in Swedish 15-year-olds with reading and writing
difficulties. In B. Arfé, J. Dockrell, & V.W. Berninger (Eds.), Writing
development and instruction in children with hearing, speech and
oral language
difficulties (pp. 242–269). Oxford University Press.