Cover not available

Article published In:
[Translation, Cognition & Behavior 4:2] 2021
► pp. 331–352

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
authorization required
thematic section

Eyetracking the impact of subtitle length and line number on viewers’ allocation of visual attention

ORCiD logo with link | Ferdowsi University of Mashhad
ORCiD logo with link | Ferdowsi University of Mashhad
Published online: 14 March 2022
DOI logo with link
https://doi.org/10.1075/tcb.00058.zah
Abstract
Compared to one-line subtitles, two-line subtitles are believed to receive more attention from viewers based on previous research. Yet, in the majority of these studies, two-liners are considerably longer than the one-line subtitles. The authors argue that the findings of the previous studies could have been affected by the difference in subtitle length, and there is a need to operationally distinguish between the impact of subtitle length and line number on viewers’ attention allocation. Therefore, an SMI eye tracker was used in this study to record the eye movements of 32 Iranian viewers while reading the Persian subtitles of a short segment of a feature film, A Prophet (Jacques Audiard 2009). The results showed that the viewers’ attention to one-line subtitles was significantly greater than the attention they allotted to two-line subtitles although they were of the same length. The attention allocated to the long subtitles was also significantly greater compared to the attention paid to the short subtitles. Retrospective interviews also showed that the participants favored short and two-line subtitles.
Article outline
  • 1.Introduction
  • 2.Literature review
    • 2.1Subtitle reading
    • 2.2Subtitle length and line number
  • 3.Method
    • 3.1Research design
    • 3.2Participants
    • 3.3Stimuli
    • 3.4Eyetracking apparatus and eye movement measures
    • 3.5Research variables
    • 3.6Procedure
  • 4.Results
    • 4.1Eyetracking experiment
      • 4.1.1Subtitle line number
      • 4.1.2Subtitle length
    • 4.2Semi-structured interviews
      • 4.2.1Subtitle line number
      • 4.2.2Subtitle line length
  • 5.Discussion
  • 6.Conclusion
  • References
References (33)
References
Abdi, Zahra, and Masood Khoshsaligheh. 2018. “Applying Multimodal Transcription to Persian Subtitling.” Studies About Languages 321: 21–38. Google Scholar logo with link to Google Scholar
Andrychowicz-Trojanowska, Agnieszka. 2018. “Basic Terminology of Eyetracking Research.” Applied Linguistics Papers 21: 123–132. Google Scholar logo with link to Google Scholar
Caffrey, Colm. 2012. “Using an Eye–tracking Tool to Measure the Effects of Experimental Subtitling Procedures on Viewer Perception of Subtitled AV Content”. In Eye Tracking in Audiovisual Translation. Edited by Elisa Perego, 223–258. Rome: Arcane. Google Scholar logo with link to Google Scholar
. 2009. Relevant Abuse? Investigating the Effects of an Abusive Subtitling Procedure on the Perception of TV Anime using Eye Tracker and Questionnaire. PhD thesis, Dublin City University.
d’Ydewalle, Géry, and Ingrid Gielen. 1992. “Attention Allocation with Overlapping Sound, Image, and Text.” In Eye Movements and Visual Cognition. Edited by Keith Rayner, 415–427. New York: Springer. Google Scholar logo with link to Google Scholar
d’Ydewalle, Géry, Caroline Praet, Karl Verfaillie, and Johan Van Rensbergen. 1991. “Watching Subtitled Television: Automatic Reading Behavior.” Communication Research 181: 650–666. Google Scholar logo with link to Google Scholar
d’Ydewalle, Géry, Joris. V. Rensbergen, and Johan Van Pollet. 1987. “Reading a Message When the Same Message is Available Auditorily in Another Language: The Case of Subtitling.” In Eye Movements: From Physiology to Cognition. Edited by O’Regan, J. K. and LevySchoen, A., 313–321. Amsterdam: Elsevier. Google Scholar logo with link to Google Scholar
d’Ydewalle, Géry, and Wim De Bruycker. 2007. “Eye Movements of Children and Adults while Reading Television Subtitles.” European Psychologist 12(3): 196–205. Google Scholar logo with link to Google Scholar
Díaz Cintas, Jorge. 2013. “Subtitling: Theory, Practice and Research.” In The Routledge Handbook of Translation Studies. Edited by Carmen Millán Varela and Francesca Bartrina Martí, 285–299. London: Routledge. Google Scholar logo with link to Google Scholar
Díaz Cintas, Jorge, and Aline Remael. 2007. Audiovisual Translation: Subtitling. Manchester: St. Jerome Publishing.Google Scholar logo with link to Google Scholar
Doherty, Stephen. 2016. “The Impact of Translation Technologies on the Process and Product of Translation.” International Journal of Communication 101: 947–969.Google Scholar logo with link to Google Scholar
Duchowski, Andrew. 2017. Eye Tracking Methodology. London: Springer. Google Scholar logo with link to Google Scholar
Elisa Perego, Fabio Del Missier, Marco Porta, and Mauro Mosconi. 2010. “The Cognitive Effectiveness of Subtitle Processing.” Media Psychology 1331: 243–272. Google Scholar logo with link to Google Scholar
Gerber Morón, Olivia, and Agnieszka Szarkowska. 2018. “Line Breaks in Subtitling: An Eye Tracking Study on Viewer Preferences.” Journal of Eye Movement Research 1131: 1–22. Google Scholar logo with link to Google Scholar
Ghia, Elisa. 2012. “The Impact of Translation Strategies on Subtitle Reading.” In Eyetracking in Audiovisual Translation. Edited by Elisa Perego, 157–182. Rome: Arcane. Google Scholar logo with link to Google Scholar
Gottlieb, Henry. 2012. “Subtitles: Readable Dialogue?” In Eye Tracking in Audiovisual Translation. Edited by Elisa Perego, 83–104. Rome: Arcane. Google Scholar logo with link to Google Scholar
Just, Marcel A., and Patricia A. Carpenter. 1980. “A Theory of Reading: From Eye Fixations to Comprehension.” Psychological Review 87(4): 329–354. Google Scholar logo with link to Google Scholar
Krejtz, Izabela, Agnieszka Szarkowska, and Krzysztof Krejtz. 2013. “The Effects of Shot Changes on Eye Movements in Subtitling.” Journal of Eye Movement Research 6(5:3): 1–12. Google Scholar logo with link to Google Scholar
Krejtz, Izabela, Agnieszka Szarkowska, and Maria Łogińska. 2016. “Reading function and content words in subtitled videos.” The Journal of Deaf Studies and Deaf Education 21(2): 222–232. Google Scholar logo with link to Google Scholar
Lång, Juha, Jukka Mäkisalo, Tersia Gowases, and Sami Pietinen. 2013. “Using Eye Tracking to Study the Effect of Badly Synchronized Subtitles on the Gaze Paths of Television Viewers.” New Voices in Translation Studies 101: 72–86. Accessed on January 20, 2020, [URL]
Lautenbacher, Olli Philippe. 2012. “From Still Pictures to Moving Pictures: Eye Tracking Text and Image.” In Eye Tracking in Audiovisual Translation. Edited by Elisa Perego, 135–156. Rome: Arcane. Google Scholar logo with link to Google Scholar
Moran, Siobhan. 2012. “The Effect of Linguistic Variation on Subtitle Reading”. In Eye Tracking in Audiovisual Translation. Edited by Elisa Perego, 183–222. Rome: Arcane. Google Scholar logo with link to Google Scholar
Mosconi, Mauro, and Marco Porta. 2012. “Accessibility and Usability in the Context of Human–Computer Interaction.” In Eye Tracking in Audiovisual Translation. Edited by Elisa Perego, 105–134. Rome: Arcane. Google Scholar logo with link to Google Scholar
Muñoz Lahoz, Carmen. 2017. “The Role of Age and Proficiency in Subtitle Reading. An Eyetracking Study.” System 671: 77–86. Google Scholar logo with link to Google Scholar
Perego, Elisa, ed. 2012. Eye Tracking in Audiovisual Translation. Rome: Aracne. Google Scholar logo with link to Google Scholar
Perego, Elisa, Monica Laskowska, Anna Matamala Ripoll, Aline Remael, Isabelle S. Robert, Agnieszka Szarkowska, Anna Vilaro Soler, and Sara Bottiroli. 2016. “Is Subtitling Equally Effective Everywhere? A First Cross-national Study on the Reception of Interlingually Subtitled Messages.” Empirical Approaches to Audiovisual Translation: Special issue of Across Languages and Cultures 1721: 205–229. Google Scholar logo with link to Google Scholar
Perego, Elisa. 2008. “Subtitles and Line-Breaks: Towards Improved Readability.” In Between Text and Image. Edited by Delia Chiaro, Christine Heiss, and Chiara Bucaria, 211–226. Amsterdam: Benjamins. Google Scholar logo with link to Google Scholar
Pernice, Kara and Jakob Nielsen. 2009. How to Conduct Eyetracking Studies. Indianapolis: New Riders Publishing.Google Scholar logo with link to Google Scholar
Praet, Caroline, Karl Verfaillie, Peter De Graef, Johan Van Rensbergen, and Géry D’Ydewalle. 1990. “A One Line Text is Not Half a Two Line Text.” In From Eye to Mind: Information Acquisition in Perception, Search and Reading edited by Rudolf Groner, Géry D’Ydewalle, and Ruth Parham, 205–213. Amsterdam: Elsevier.Google Scholar logo with link to Google Scholar
Rayner, Keith. 1998. “Eye Movements in Reading and Information Processing: 20 years of Research.” Psychological Bulletin 12431: 372–422. Google Scholar logo with link to Google Scholar
Szarkowska, Agnieszka, and Olivia Gerber Morón. 2019. “Two or Three Lines: A Mixed-methods Study on Subtitle Processing and Preferences.” Perspectives: Studies in Translation Theory and Practice 2711: 144–164. Google Scholar logo with link to Google Scholar
Szarkowska, Agnieszka, Izabela Krejtz, Krzysztof Krejtz, and Andrew Duchowski. 2013. “Harnessing the Potential of Eyetracking for Media Accesibility.” In Translation Studies and Eyetracking Analysis. Edited by Sambor Grucza, Monika Pluzyczka, and Justyna Zajac, 153–183. Frankfurt: Peter Lang.Google Scholar logo with link to Google Scholar
Cited by (4)

Cited by four other publications

Mukminin, Muhamad Saiful, Ahmad Abdul Muhhit, Libra Dui Putra & Md. Kamruzzaman Khandoker
2025. Resistance of Indonesian cultural identity translation into English in Imperfect The Series. Linguistics Initiative 5:2 ► pp. 436 ff. DOI logo
Zhao, Xiaojing, Emmanuele Chersoni, Chu-Ren Huang & Han Xu
2025.  Translating vulgar language in video game localization: a case study of Black Myth: Wukong . Perspectives ► pp. 1 ff. DOI logo
Cui, Ying & Xiao Liu
2024. How condensation and non-condensation impact viewers’ processing effort and comprehension – an eye-tracking study on Chinese subtitling of English documentaries. Perspectives ► pp. 1 ff. DOI logo
Chen, Jing, Lu Zhang & Wenhai Qian
2023. Cognitive differences between readers attentive and inattentive to task-related information: an eye-tracking study. Aslib Journal of Information Management 75:5 ► pp. 917 ff. DOI logo

This list is based on CrossRef data as of 5 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue