Cover not available

In:Eye Tracking and Multidisciplinary Studies on Translation
Edited by Callum Walker and Federico M. Federici
[Benjamins Translation Library 143] 2018
► pp. 185–201

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload Book PDF
authorization required

Chapter 9
Visual attention distribution in intralingual respeaking

An eye-tracking study

ORCiD logo with link
ORCiD logo with link
Published online: 16 October 2018
DOI logo with link
https://doi.org/10.1075/btl.143.09sza
Abstract
Respeaking is a method of producing real-time subtitles for live television programmes, enabling access to the media for people who are deaf, hard of hearing or who support their viewing with subtitles. Respeaking requires a set of skills akin to both interpreting and subtitling, including multitasking and management of concurrent sources of incoming information. In this chapter we present the results of an eye-tracking study on the visual attention of respeakers during an intralingual respeaking task (Polish to Polish). We tested 57 people while they were respeaking a 5-minute news programme. Participants also underwent a short proof-reading task. There were three groups of participants: interpreters, translators and a control group of people with no interpreting/translation experience. We examined the number of fixations and mean fixation duration on major screen areas: picture, subtitles, dictation area and subtitle panel. We found that translators who had experience in subtitling were able to manage their visual attention most efficiently as they fixated more often on key screen areas and their fixations were longer than in other groups. They also achieved the highest score on the proof-reading task, which suggest they could work in respeaking as editors.
Article outline
  • 1.Introduction
    • 1.1Respeaking
    • 1.2Visual attention distribution
    • 1.3Eye tracking
  • 2.Method
    • 2.1Participants
    • 2.2Materials
      • 2.2.1Respeaking test
      • 2.2.2Proof-reading test
      • 2.2.3Procedure
    • 2.3Eye-tracking data analysis
  • 3.Results and discussion
    • 3.1Mean fixation duration
    • 3.2The number of fixations
    • 3.3Proof-reading test
  • 4.Conclusions
  • Acknowledgements
  • References
References (36)
References
Cambra, Cristina, Olivier Penacchio, Núria Silvestre, and Aurora Leal. 2014. “Visual Attention to Subtitles When Viewing a Cartoon by Deaf and Hearing Children: An Eye-tracking Pilot Study.” Perspectives 22 (4): 607–617..Google Scholar logo with link to Google Scholar
Carney, Russell, and Joel Levin. 2002. “Pictorial Illustrations Still Improve Students’ Learning from Text.” Educational Psychology Review 14 (1): 5–26..Google Scholar logo with link to Google Scholar
Carroll, Patrick J., Jason R. Young, and Michael S. Guertin. 1992. “Visual Analysis of Cartoons: A View From the Far Side.” In Eye Movements and Visual Cognition: Scene Perception and Reading, ed. by Keith Rayner, 444–461. New York: Springer-Verlag.Google Scholar logo with link to Google Scholar
De Linde, Zoe, and Neil Kay. 1999. The Semiotics of Subtitling. Manchester: St. Jerome Publishing.Google Scholar logo with link to Google Scholar
d’Ydewalle, Géry, and Wim De Bruycker. 2007. “Eye Movements of Children and Adults While Reading Television Subtitles.” European Psychologist 12 (3): 196–205..Google Scholar logo with link to Google Scholar
d’Ydewalle, Gery, Caroline Praet, Karl Verfaillie, and Johan Van Rensbergen. 1991. “Watching Subtitled Television: Automatic Reading Behavior.” Communication Research 18 (5): 650–666.Google Scholar logo with link to Google Scholar
d’Ydewalle, Géry, and Ingrid Gielen. 1992. “Attention Allocation with Overlapping Sound, Image, and Text.” In Eye Movements and Visual Cognition: Scene Perception and Reading, ed. by Keith Rayner, 415–427. New York, NY: Springer New York.Google Scholar logo with link to Google Scholar
Germeys, Filip, and Géry d’Ydewalle. 2007. “The Psychology of Film: Perceiving Beyond the Cut.” Psychological Research 71 (4): 458–466..Google Scholar logo with link to Google Scholar
Ghia, Elisa. 2012. Subtitling Matters: New Perspectives on Subtitling and Foreign Language Learning. Oxford: Peter Lang.Google Scholar logo with link to Google Scholar
Hershler, Orit, and Shaul Hochstein. 2005. “At First Sight: A High-level Pop Out Effect for Faces.” Vision Research 45 (13): 1707–1724..Google Scholar logo with link to Google Scholar
Holmqvist, Kenneth, Marcus Nyström, Richard Andersson, Richard Dewhurst, Halszka Jarodzka, and Joost Van De Weijer. 2011. Eye Tracking: A Comprehensive Guide to Methods and Measures. Oxford, United Kingdom : Oxford University Press.Google Scholar logo with link to Google Scholar
Jensema, Carl J., Ramalinga Sarma Danturthi, and Robert Burch. 2000. “Time Spent Viewing Captions on Television Programs.” American Annals of the Deaf 145 (5): 464–468.Google Scholar logo with link to Google Scholar
Jensema, Carl J., Sameh El Sharkawy, Ramalinga Sarma Danturthi, Robert Burch, and David Hsu. 2000. “Eye Movement Patterns of Captioned Television Viewers.” American Annals of the Deaf 145 (3): 275–285.Google Scholar logo with link to Google Scholar
Koolstra, Cees M., Tom H. A. Van Der Voort, and Géry d’Ydewalle. 1999. “Lengthening the Presentation Time of Subtitles on Television: Effects on Children’s Reading Time and Recognition.” comm 24 (4): 407–422..Google Scholar logo with link to Google Scholar
Krejtz, Izabela, Agnieszka Szarkowska, and Krzysztof Krejtz. 2013. “The Effects of Shot Changes on Eye Movements in Subtitling.” Journal of Eye Movement Research 6 (5): 1–12.Google Scholar logo with link to Google Scholar
Krejtz, Krzysztof, Andrew Duchowski, Izabela Krejtz, Agnieszka Szarkowska, and Agata Kopacz. 2016. “Discerning ambient/focal attention with coefficient K.” ACM Transactions on Applied Perception 13 (3): 11..Google Scholar logo with link to Google Scholar
Kruger, Jan-Louis, Este Hefer, and Gordon Matthew. 2013. “Measuring the Impact of Subtitles on Cognitive Load: Eye Tracking and Dynamic Audiovisual Texts.” Proceedings of the 2013 Conference on Eye Tracking South Africa, Cape Town, South Africa.Google Scholar logo with link to Google Scholar
Kruger, Jan-Louis, Esté Hefer, and Gordon Matthew. 2014. “Attention Distribution and Cognitive Load in a Subtitled Academic Lecture: L1 vs. L2.” Journal of Eye Movement Research 7 (5): 1–15.Google Scholar logo with link to Google Scholar
Kruger, Jan‐Louis, and Faans Steyn. 2014. “Subtitles and Eye Tracking: Reading and Performance.” Reading Research Quarterly 49 (1): 105–120..Google Scholar logo with link to Google Scholar
Langton, Stephen R. H., Anna S. Law, A. Mike Burton, and Stefan R. Schweinberger. 2008. “Attention Capture by Faces.” Cognition 107 (1): 330–342..Google Scholar logo with link to Google Scholar
Markowski, Andrzej. 2011. Kultura języka polskiego. Teoria. Zagadnienia leksykalne. Warsaw: PWN.Google Scholar logo with link to Google Scholar
Mital, Parag K., Tim J. Smith, Robin L. Hill, and John M. Henderson. 2010. “Clustering of Gaze During Dynamic Scene Viewing is Predicted by Motion.” Cognitive Computation 3 (1): 5–24..Google Scholar logo with link to Google Scholar
Orrego-Carmona, David, Łukasz Dutka, and Agnieszka Szarkowska. 2016a. “Expanding the Boundaries: Methodological Considerations for Subtitling Process Research.” 8th EST Congress, Aarhus University, Aarhus.Google Scholar logo with link to Google Scholar
. 2016b. “Using Process Methods to Study Subtitles.” First South African Inter-varsity Translation and Interpreting Conference, North-West University, Vanderbijlpark.Google Scholar logo with link to Google Scholar
. 2018. “Using Translation Process Research to Explore the Creation of Subtitles: An Eye Tracking Study Comparing Professional and Trainee Subtitlers.” Journal of Specialised Translation 30.Google Scholar logo with link to Google Scholar
Perego, Elisa, Fabio Del Missier, Marco Porta, and Mauro Mosconi. 2010. “The Cognitive Effectiveness of Subtitle Processing.” Media Psychology 13 (3): 243–272..Google Scholar logo with link to Google Scholar
Rajendran, Dhevi J., Andrew T. Duchowski, Pilar Orero, Juan Martínez, and Pablo Romero-Fresco. 2013. “Effects of Text Chunking on Subtitling: A Quantitative and Qualitative Examination.” Perspectives 21 (1): 5–21..Google Scholar logo with link to Google Scholar
Rayner, Keith. 1998. “Eye Movements in Reading and Information Processing: 20 Years of Research.” Psychological Bulletin 124 (3): 372–422..Google Scholar logo with link to Google Scholar
. 2009. “Eye Movements and Attention in Reading, Scene Perception, and Visual Search.” The Quarterly Journal of Experimental Psychology 62 (8): 1457–1506..Google Scholar logo with link to Google Scholar
Romero-Fresco, Pablo. 2011. Subtitling Through Speech Recognition: Respeaking. Manchester: St. Jerome Publishing.Google Scholar logo with link to Google Scholar
Romero Fresco, Pablo. 2012. “Respeaking in Translator Training Curricula. Present and Future Prospects.” The Interpreter and Translator Trainer 6 (1): 91–112.Google Scholar logo with link to Google Scholar
Szarkowska, Agnieszka, Izabela Krejtz, Zuzanna Klyszejko, and Anna Wieczorek. 2011. “Verbatim, Standard, or Edited? Reading Patterns of Different Captioning Styles among Deaf, Hard of Hearing, and Hearing Viewers.” American Annals of the Deaf 156 (4): 363–378.Google Scholar logo with link to Google Scholar
Szarkowska, Agnieszka, Krzysztof Krejtz, Łukasz Dutka, and Olga Pilipczuk. 2016. “Cognitive Load in Intralingual and Interlingual Respeaking – A Preliminary Study.” Poznan Studies in Contemporary Linguistics 52 (2): 209–233.Google Scholar logo with link to Google Scholar
. 2018. “Are Interpreters Better Respeakers?”. The Interpreter and Translator Trainer: 1–20.Google Scholar logo with link to Google Scholar
Yarbus, Alfred L. 1967. Eye Movements and Vision. Translated by Basil Haigh. New York: Plenum Press.Google Scholar logo with link to Google Scholar
Cited by (6)

Cited by six other publications

Cui, Ying & Xiao Liu
2025. An Eye Tracking Study on the Reception of Second-Person Pronouns in English-Chinese Advertisement Translation. SAGE Open 15:3 DOI logo
Walker, Callum, Kristian Tangsgaard Hvelplund & Victoria Lei
2025. Screen eyetracking. In Research Methods in Cognitive Translation and Interpreting Studies [Research Methods in Applied Linguistics, 10], ► pp. 213 ff. DOI logo
Chen, Sijia & Jan-Louis Kruger
2024. Visual processing during computer-assisted consecutive interpreting. Interpreting. International Journal of Research and Practice in Interpreting 26:2 ► pp. 231 ff. DOI logo
Cui, Ying, Xiao Liu & Wei Wang
2024. Reliability of Effort Indicators for Human Translation and Post-editing of Machine Translation: An Eye Tracking and Keylogging Study Involving Student Translators. In Emerging Technologies for Education [Lecture Notes in Computer Science, 14606], ► pp. 207 ff. DOI logo
Cui, Ying, Xiao Liu & Yuqin Cheng
2023. A Comparative Study on the Effort of Human Translation and Post-Editing in Relation to Text Types: An Eye-Tracking and Key-Logging Experiment. Sage Open 13:1 DOI logo
Josephy-Hernández, Daniel E.
2023. Ranzato, Irene and Zanotti, Serenella (2018): Reassessing Dubbing: Historical Approaches and Current Trends. Amsterdam: John Benjamins Publishing Company. 287 p.. Meta 67:2 ► pp. 485 ff. DOI logo

This list is based on CrossRef data as of 3 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue