Cover not available

Article published In: Cognitive Translation and Interpreting Studies in the Early Twenty First Century
Edited by Adolfo M. García, Edinson Muñoz and Néstor Singer
[Translation, Cognition & Behavior 6:2] 2023
► pp. 164–186

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
EPUB logo with download linkDownload EPUB
authorization required

Wearable eye trackers

Methodological challenges, opportunities and perspectives for sight interpreting/translation

ORCiD logo with link | Dalian Maritime University
ORCiD logo with link | University of Copenhagen
ORCiD logo with link | Queen’s University Belfast
Published online: 7 March 2024
DOI logo with link
https://doi.org/10.1075/tcb.00084.xia
Abstract
Sight interpreting/translation (SiT) refers to the mode of communication in which source language information is received via reading and target language output is produced either in oral form or sign language. The cognitive aspect of SiT has been examined empirically with participant-, product-, and process-oriented methods, as well as multi-method approaches. Previous SiT research has benefitted from eye tracking technology due to the dominance of visual input during SiT. However, previous studies have used screen-based eye trackers, where stimuli are confined to the screen, and the potential impact of elements beyond the screen cannot be captured, leading to an oversight of the interactional aspect of SiT. Thus, we suggest wearable eye trackers in future SiT studies to thoroughly explore the underlying cognitive mechanisms of this modality. Moreover, we argue that future SiT studies can benefit from triangulating eye tracking data with subjective data, such as interviews, to better understand SiT.
Article outline
  • 1.Introduction
    • 1.1Cognitive SiT studies with participant-oriented methods
    • 1.2Cognitive SiT studies with product-oriented methods
    • 1.3Cognitive SiT studies with process-oriented methods
    • 1.4Cognitive SiT studies with multi-method approaches
  • 2.Wearable eye tracking equipment
    • 2.1Technological principles, types of equipment and indicators
    • 2.2Assumptions and hypotheses
  • 3.SiT and eye tracking glasses – reflections on data collection, management and analysis
    • 3.1Collecting eye tracking data for SiT studies
    • 3.2Managing eye tracking data in SiT studies
    • 3.3Combining eye tracking with other methods in SiT
  • 4.Wearable eye trackers in SiT: Potential and methodological considerations
    • 4.1The future of SiT and wearable eye trackers
  • Note
  • References
References (55)
References
Alves, Fabio, Adriana Pagano, and Igor Da Silva. 2011. “Towards an Investigation of Reading Modalities in/for Translation: An Exploratory Study Using Eye-tracking Data.” In Cognitive Explorations of Translation, edited by Sharon O’Brien, 175–196. London: Continuum International Publishing Group.Google Scholar logo with link to Google Scholar
Blignaut, Pieter. 2009. “Fixation Identification: The Optimum Threshold for a Dispersion Algorithm.” Attention, Perception, & Psychophysics 71 (4): 881–895. Google Scholar logo with link to Google Scholar
Chang, Huei-Fang. 2008. “A Study on GITI Students’ ST Difficulty & Performance.” Spectrum: Studies in Language, Literature, Translation, and Interpretation 21: 61–83.Google Scholar logo with link to Google Scholar
Chen, Sijia. 2017. “The Construct of Cognitive Load in Interpreting and its Measurement.” Perspectives 25 (4): 640–657. Google Scholar logo with link to Google Scholar
Chiang, Heien-Kun, Feng-Lan Kuo, and Wei-Chun Chen. 2009. “Exploring Pausing Patterns in Two-Way Sight Translation.” Spectrum: Studies in Language, Literature, Translation, and Interpretation 51: 155–168.Google Scholar logo with link to Google Scholar
Chmiel, Agnieszka, Przemysław Janikowski, and Anna Cieślewicz. 2020. “The Eye or the Ear?: Source Language Interference in Sight Translation and Simultaneous Interpreting.” Interpreting 22 (2): 187–210. Google Scholar logo with link to Google Scholar
Dragsted, Barbara, and Inge G. Hansen. 2009. “Exploring Translation and Interpreting Hybrids. The Case of Sight Translation.” Meta: Journal des Traducteurs/Meta: Translators’ Journala 54 (3): 588–604. Google Scholar logo with link to Google Scholar
Ehrlich, Susan F., and Keith Rayner. 1981. “Contextual Effects on Word Perception and Eye Movements During Reading.” Journal of Verbal Learning and Verbal Behavior 20 (6): 641–655. Google Scholar logo with link to Google Scholar
Fang, Jing, and Jihong Wang. 2022. “Student Interpreters’ Strategies in Dealing with Unfamiliar Words in Sight Translation.” Translation & Interpreting 14 (1): 42–65. Google Scholar logo with link to Google Scholar
Fang, Jing, Xiaomin Zhang, and Haidee Kotze. 2022. “The Effects of Training on Reading Behaviour and Performance in Sight Translation: A Longitudinal Study Using Eye-Tracking.” Perspectives 31 (4): 1–17.Google Scholar logo with link to Google Scholar
Gorszczyńska, Paula. 2020. “Disfluencies in Sight Translation Vis-à-Vis Dominating Text Function: A Pilot Study Based on English-Polish Sight Translation Performed by Professional Interpreters.” Beyond Philology 17 (4): 95–130. Google Scholar logo with link to Google Scholar
Havnen, Randi. 2019. “Multimodal and Interactional Aspects of Sight Translation–A Critical Review.” FITISPos International Journal 6 (1): 91–106. Google Scholar logo with link to Google Scholar
He, Yan, and Yinying Hu. 2022. “Functional Connectivity Signatures Underlying Simultaneous Language Translation in Interpreters and Non-Interpreters of Mandarin and English: An fNIRS Study.” Brain Sciences 12 (2): 273. Accessed January 3, 2023. Google Scholar logo with link to Google Scholar
Ho, Chen-En. 2017. An Integrated Eye-Tracking Study into the Cognitive Process of English-Chinese Sight Translation: Impacts of Training and Experience. PhD Thesis, National Taiwan Normal University, Taipei.
. 2022. “Sight Translation/Interpreting.” Encyclopedia of Translation and Interpreting. Accessed December 10, 2022. [URL]
Ho, Chen-En, andJie-Li Tsai. 2020. “How does Training Shape English-Chinese Sight Translation Behaviour?: An Eyetracking Study.” Translation, Cognition & Behavior 3 (1): 1-24.Google Scholar logo with link to Google Scholar
Ho, Chen-En, Kristian T. Hvelplund, and Yao Xiao. (Under review). “Exploring Interpreters’ Situation Awareness in Sight Interpreting/Translation Tasks.” Translation and Interpreting Studies.
Holmqvist, Kenneth., Marcus Nyström, Richard Andersson, Richard Dewhurst, Halszka Jarodzka, and Joost van de Weijer. 2011. Eye Tracking: A Comprehensive Guide to Methods and Measures. New York: Oxford University Press.Google Scholar logo with link to Google Scholar
Hvelplund, Kristian T. 2014. “Eye Tracking and the Translation Process: Reflections on the Analysis and Interpretation of Eye-Tracking Data.” In Minding Translation, ed. by Ricardo Muñoz Martín, special issue of MonTI. Monografías de Traducción e Interpretación 11: 201–223.Google Scholar logo with link to Google Scholar
Inhoff, Albrecht W., and Keith Rayner. 1986. “Parafoveal Word Processing During Eye Fixations in Reading: Effects of Word Frequency.” Perception & Psychophysics 40 (6): 431–439. Google Scholar logo with link to Google Scholar
Jakobsen, Arnt L., and Kristian T. H. Jensen. 2008. “Eye Movement Behaviour across Four Different Types of Reading Task.” In Looking at Eyes: Eye-Tracking Studies of Reading and Translation Processing, edited by Susanne Göpferich, Arnt L. Jakobsen, and Inger M. Mees, 103–124. Copenhagen: Samfundslitteratur.Google Scholar logo with link to Google Scholar
Jiménez Ivars, Amparo. 2008. “Sight Translation and Written Translation. A Comparative Analysis of Causes of Problems, Strategies and Translation Errors within the PACTE Translation Competence Model.” FORUM. Revue internationale d’interprétation et de traduction/International Journal of Interpretation and Translation 6 (2): 79–104. Accessed February 15, 2023. Google Scholar logo with link to Google Scholar
Just, Marcel A., and Patricia A. Carpenter. 1980. “A Theory of Reading: From Eye Fixations to Comprehension.” Psychological Review, 87 (4): 329–354. Accessed March 1, 2023. Google Scholar logo with link to Google Scholar
Kokanova, Elena S., Maya M. Lyutyanskaya, and Anna S. Cherkasova. 2018. “Eye Tracking Study of Reading and Sight Translation.” SHS Web of Conferences, 50 (01080). Accessed January 8, 2023. Google Scholar logo with link to Google Scholar
Korpal, Paweł. 2012. “On Language-Pair Specificity in Sight Translation: An Eye-Tracking Study.” In Übersetzen in die Zukunft, edited by Wolfram Baur, Sylvia Kalina, Felix Mayer, and Jutta Witzel, 522–530. Berlin: BDÜ Fachverlag.Google Scholar logo with link to Google Scholar
Lambert, Sylvie. 2004. “Shared Attention During Sight Translation, Sight Interpretation and Simultaneous Interpretation.” Meta: Journal des Traducteurs/Meta: Translators’ Journal 49 (2): 294–306. Google Scholar logo with link to Google Scholar
Lee, Jieun. 2012. “What Skills Do Student Interpreters Need to Learn in Sight Translation Training?” Meta: Journal des Traducteurs/Meta: Translators’ Journal 57 (3): 694–714. Google Scholar logo with link to Google Scholar
Lijewska, Agnieszka, Agnieszka Chmiel, and Albrecht W. Inhoff. 2022. “Stages of Sight Translation: Evidence from Eye Movements.” Applied Psycholinguistics 43 (5): 997–1018. Accessed January 3, 2023. Google Scholar logo with link to Google Scholar
Ma, Xingcheng, Dechao Li, and Yu-Yin Hsu. 2021. “Exploring the Impact of Word Order Asymmetry on Cognitive Load During Chinese–English Sight Translation.” Target 33 (1): 103–131. Accessed January 3, 2023. Google Scholar logo with link to Google Scholar
Ma, Xingcheng, Dechao Li, Jie-Li Tsai, and Yu-Yin Hsu. 2022. “An Eye-Tracking Based Investigation into Reading Behavior During Chinese-English Sight Translation: The Effect of Word Order Asymmetry.” Translation & Interpreting 14 (1): 66–83. Google Scholar logo with link to Google Scholar
O’Brien, Sharon. 2009. “Eye Tracking in Translation Process Research: Methodological Challenges and Solutions.” In Methodology, Technology and Innovation in Translation Process Research: A Tribute to Arnt Lykke Jakobsen, edited by Inger M. Mees, Fabio Alves, and Susanne Göpferich, 251–266. Copenhagen: Samfundslitteratur.Google Scholar logo with link to Google Scholar
Pedersen, Emile S., and Helle V. Dam. 2017. “Short-Term Memory in the Production Phase of Sight Translation.” HERMES-Journal of Language and Communication in Business 27 (52): 93–105. Google Scholar logo with link to Google Scholar
Pontrandolfo, Gianluca. 2016. “Sight Translation in Healthcare Settings: A Case-Study.” In Translating Orality, ed. by Cesáreo Calvo Rigual, and Nicoletta Spinolo, special issue of MonTI. Monografías de Traducción e Interpretación (3): 367–398. Accessed January 8, 2023. Google Scholar logo with link to Google Scholar
Posner, Michael I. 1980. “Orienting of Attention.” Quarterly Journal of Experimental Psychology 32 (1): 3–25. Accessed March 15, 2023. Google Scholar logo with link to Google Scholar
Pupil Labs. 2023a. “Products.” Accessed March 1, 2023. [URL]
Pupil Labs. 2023b. “Pupil Core.” Accessed March 1, 2023. [URL]
Rayner, Keith. 1998. “Eye Movements in Reading and Information Processing: 20 Years of Research.” Psychological Bulletin 124 (3): 372–422. Google Scholar logo with link to Google Scholar
Saldanha, Gabriela, and Sharon O’Brien. 2014. Research Methodologies in Translation Studies. Routledge. Google Scholar logo with link to Google Scholar
Setton, Robin, and Andrew Dawrant. 2016. Conference Interpreting: A Complete Course. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Shreve, Gregory M., Isabel Lacruz, and Erik Angelone. 2010. “Cognitive Effort, Syntactic Disruption, and Visual Interference in a Sight Translation Task.” In Translation and Cognition, edited by Gregory M. Shreve, and Erik Angelone, 63–84. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
. 2011. “Sight Translation and Speech Disfluency. Performance Analysis as a Window to Cognitive Translation Processes.” In Methods and Strategies of Process Research, edited by Cecilia Alvstad, Adelina Hild, and Elisabet Tiselius, 93–120. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
SMI. n.d. “SMI Eye Tracking Glasses.” Accessed March 1, 2023. [URL]
Su, Wenchao. 2020. Eye-Tracking Processes and Styles in Sight Translation. Singapore: Springer. Google Scholar logo with link to Google Scholar
Tiselius, Elisabet, and Kayle Sneed. 2020. “Gaze and Eye Movement in Dialogue Interpreting: An Eye-Tracking Study.” Bilingualism: Language and Cognition 23 (4): 780–787. Google Scholar logo with link to Google Scholar
Tobii. 2023a. “Tobii Pro Glasses 3.” Accessed March 1, 2023. [URL]
. 2023b. “Tobii Eye Tracking Whitepaper.” Accessed March 1, 2023. [URL]
Vargas-Urpi, Mireia. 2019. “Sight Translation in Public Service Interpreting: A Dyadic or Triadic Exchange?” The Interpreter and Translator Trainer 13 (1): 1–17. Accessed July 9, 2023. Google Scholar logo with link to Google Scholar
Wallot, Sebastian, Geoff Hollis, and Marieke van Rooij. 2013. “Connected Text Reading and Differences in Text Reading Fluency in Adult Readers.” PLoS ONE 8 (8): e71914. Accessed July 3, 2023. Google Scholar logo with link to Google Scholar
Wang, Zishan, Julien Epps, and Siyuan Chen. 2021. “An Investigation of Automatic Saccade and Fixation Detection from Wearable Infrared Cameras.” 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC), October 17–20, 2021, 2250–2257. IEEE. Accessed July 3, 2023. Google Scholar logo with link to Google Scholar
Cited by (1)

Cited by one other publication

Ho, Chen-En & Jie-Li Tsai
2025. Reader differences in navigating English–Chinese sight interpreting/translation. Poznan Studies in Contemporary Linguistics 61:4 ► pp. 457 ff. DOI logo

This list is based on CrossRef data as of 5 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue