Cover not available

Article published In: Cognitive Translation and Interpreting Studies in the Early Twenty First Century
Edited by Adolfo M. García, Edinson Muñoz and Néstor Singer
[Translation, Cognition & Behavior 6:2] 2023
► pp. 187–210

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
EPUB logo with download linkDownload EPUB
authorization required

Cognition and behaviour of reception in museum spaces

A critical review of eye tracking research on museum translation (2010–2022)

ORCiD logo with link | Tianjin University of Finance and Economics | Durham University
ORCiD logo with link | Oxford University
ORCiD logo with link | Durham University
Published online: 7 March 2024
DOI logo with link
https://doi.org/10.1075/tcb.00085.xu
Abstract
In recent years, there has been a growing interest in translation studies within museum settings, enabling museums to enhance visitor engagement and create a more meaningful visiting experience. Within cognitive translation studies, the use of eye tracking technology has emerged as a widely adopted method for investigating translators’ allocation of visual attention and cognitive resources. However, the application of eye tracking in museum translation studies has received limited attention. This study provides a critical review of the utilisation of eye tracking to examine visitors’ perception and reception in museum settings from both behavioural and cognitive perspectives. The article begins by selecting and categorising the reviewed papers. It then describes the methods employed for collecting and analysing eye movement data, followed by summaries and critical comments on the findings from the existing literature. This article further evaluates the reliability, validity, and practicality of existing eye tracking research in museum translation, and finally proposes the potential directions for future cognitive translation studies in museums.
Article outline
  • 1.Introduction
  • 2.Methods
    • 2.1Research questions
    • 2.2Selection of the reviewed papers
    • 2.3Categorisation of the reviewed papers
    • 2.4Data analysis
  • 3.Results
    • 3.1Data collecting methods
    • 3.2Eye movement data analysis
    • 3.3Findings reported in the reviewed papers
      • 3.3.1Findings on six types of intermodal translation
        • Type one: Interaction between objects and written texts
        • Type two: Interaction between objects and audio description
        • Type three: Interaction between objects and digital devices
        • Type four: Interaction between written texts and digital devices
        • Type five: Interaction between different digital devices
        • Type six: Interaction between paper materials and digital devices
      • 3.3.2Findings on three types of intramodal translation
        • Type one: Interaction between written texts and audio description
        • Type two: Interlingual translation
        • Type three: Interaction between objects
  • 4.Discussion: Reliability, validity, and practicality of eye tracking research on museum translation
    • 4.1Reliability
    • 4.2Validity
    • 4.3Practicality
  • 5.Directions for future cognitive translation studies in museums
  • 6.Conclusion
  • References
References (59)
References
Bal, Mieke. 2011. “Exposing the Public.” In A Companion to Museum Studies, edited by Sharon Macdonald, 525–542. Oxford: Wiley-Blackwell.Google Scholar logo with link to Google Scholar
Bitgood, Stephen. 2013. Attention and Value: Keys to Understanding Museum Visitors. Walnut Creek: Left Coast Press.Google Scholar logo with link to Google Scholar
Black, Graham. 2005. The Engaging Museum: Developing Museums for Visitor Involvement. London: Routledge. Google Scholar logo with link to Google Scholar
Buquet, Coralie, Jacques Charlier, and Vincent Paris. 1988. “Museum Application of an Eye Tracker.” Medical & Biological Engineering & Computing 261: 277–281. Google Scholar logo with link to Google Scholar
Di Giovanni, Elena. 2020. “Eye Tracking and the Museum Experience in Italy.” Altre Modernità 241: 10–24. Google Scholar logo with link to Google Scholar
Dondi, Piercarlo, Porta, Marco, Angelo Donvito, and Giovanni Volpe. 2021. “A Gaze-based Interactive System to Explore Artwork Imagery.” Journal on Multimodal User Interfaces 161: 55–67. Google Scholar logo with link to Google Scholar
Duchowski, Andrew T. 2002. “A Breadth-first Survey of Eye Tracking Applications.” Behavior Research Methods, Instruments, & Computers: A Journal of the Psychonomic Society 34 (4): 455–470. Google Scholar logo with link to Google Scholar
Falk, John H. and Lynn D. Dierking. 1992. The Museum Experience. Walnut Creek: Left Coast Press.Google Scholar logo with link to Google Scholar
. 2000. Learning from Museums: Visitor Experiences and the Making of Meaning. Walnut Creek: Alta Mira Press.Google Scholar logo with link to Google Scholar
. 2013. Museum Experience Revisited. Walnut Creek: Left Coast Press.Google Scholar logo with link to Google Scholar
Federici, Federico Marco, and Walker, Callum. 2018. “A Mapping Exercise: Eye Tracking and Translation.” In Eye Tracking and Multidisciplinary Studies on Translation, edited by Callum Walker and Federico Marco Federici, 11–29. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Frisch, Juliette. 2011. “How Can We Define the Role of Language in Museum Interpretation.” In Museum Gallery Interpretation and Material Culture, edited by Juliette Frisch, 97–105. New York: Routledge.Google Scholar logo with link to Google Scholar
Garbutt, Michael, Scott East, Branka Spehar, Vicente Estrada-Gonzalez, Brooke Carson-Ewart, and Josephine Touma. 2020. “The Embodied Gaze: Exploring Applications for Mobile Eye Tracking in the Art Museum.” Visitor Study 23 (1): 82–100. Google Scholar logo with link to Google Scholar
Hall, Edward T. 1966. The Hidden Dimension. New York: Doubleday.Google Scholar logo with link to Google Scholar
Hooper-Greenhill, Eilean. 2000. Museums and the Interpretation of Visual Culture, 1st ed. London: Routledge. Google Scholar logo with link to Google Scholar
Hsieh, Yu-Ling, Ming-Feng Lee, Guey-Shya Chen, and Wei-Jie Wang. 2022. “Application of Visitor Eye Movement Information to Museum Exhibit Analysis.” Sustainability 14 (11): 6932. Google Scholar logo with link to Google Scholar
Hutchinson, Rachel S., and Alison F. Eardley. 2019. “Museum Audio Description: The Problem of Textual Fidelity.” Perspectives 27 (1): 42–57. Google Scholar logo with link to Google Scholar
. 2021. “Inclusive Museum Audio Guides: ‘Guided Looking’ through Audio Description Enhances Memorability of Artworks for Sighted Audiences.” Museum Management and Curatorship 361: 427–446. Google Scholar logo with link to Google Scholar
ICOM. 2022. “ICOM Approves a New Museum Definition.” Accessed 28 August 2022. [URL]
Jakobson, Roman. 1959. “On Linguistic Aspects of Translation.” In On Translation, edited by Reuben A. Brower, 232–239. Cambridge, MA: Harvard University Press.Google Scholar logo with link to Google Scholar
Kaindl, Klaus. 2020. “A Theoretical Framework for a Multimodal Conception of Translation.” In Translation and Multimodality, edited by Monica Boria, Ángeles Carreres, María Noriega-Sánchez, and Marcus Tomalin, 49–70. London: Routledge.Google Scholar logo with link to Google Scholar
Kastner, Sabine, and Mark A. Pinsk. 2004. “Visual Attention as A Multilevel Selection Process.” Cognitive, Affective, & Behavioral Neuroscience 41: 483–500. Google Scholar logo with link to Google Scholar
Koliou, Adamantia. 1997. “Foreign Languages and Their Role in Access to Museums.” Museum Management and Curatorship 16 (1): 71–76. Google Scholar logo with link to Google Scholar
Komarac, Tanja, Đurđana Ozretić Došen, and Vatroslav Škare. 2014. “Museum Marketing and Virtual Museums in 21st Century: Can Museums Survive without it?” 5th EMAC Regional Conference – Marketing Theory Challenges in Emerging Markets. Katowice, Poland. Google Scholar logo with link to Google Scholar
Krogh-Jespersen, Sheila, Kimberly A. Quinn, William L. D. Krenzer, Christine Nguyen, Jana Greenslit, and C. Aaron Price. 2020. “Exploring the Awe-some: Mobile Eye Tracking Insights into Awe in a Science Museum.” PLoS ONE 15 (9): e0239204. Google Scholar logo with link to Google Scholar
Liao, Min-Hsiu. 2018. “Museums and Creative Industries: The Contribution of Translation Studies.” The Journal of Specialised Translation 291: 45–62. [URL]
. 2019. “Translating Multimodal Texts in Space: A Case Study of St Mungo Museum of Religious Life and Art.” Linguistica Antverpiensia New Series–Themes in Translation Studies 171: 84–98. [URL].
. 2020. “Translating Trauma: Time Journey in a Memorial Museum.” In Translation and Time: Migration, Culture and Identity, edited by James St. André, 126–141. Kent, Ohio: Kent State University Press.Google Scholar logo with link to Google Scholar
. 2021. “A Journey Home? Cultural Back-translation of Ethnographic Artefacts in Museums.” In Translation – Art Communication – Museum, edited by Barbara Ahrens, Silvia Hansen-Schirra, Monika Krein-Kühle, Michael Schreiber, and Ursula Wienen, 99–115. Berlin: Frank & Timme.Google Scholar logo with link to Google Scholar
. 2021. “Christianity on Display: A Semiotic Study of Two Museums of World Religions (Glasgow, Taipei).” Church, Communication and Culture 6 (2): 383–401. Google Scholar logo with link to Google Scholar
Liao, Min-Hsiu, and Phil Bartie. 2022. “Translating Heritage: A Study of Visitors’ Experiences Mediated through Multilingual Audio Guides in Edinburgh Castle.” Journal of Heritage Tourism 17 (3): 283–295. Google Scholar logo with link to Google Scholar
Mandolesi, Serena, Danilo Gambelli, Simona Naspetti, and Raffaele Zanoli. 2022. “Exploring Visitors’ Visual Behavior Using Eye Tracking: The Case of the ‘Studiolo Del Duca’” Journal of Imaging 8 (1): 8. Google Scholar logo with link to Google Scholar
Marina, Manfredi. 2021. “Professional Museum Translators for Promoting Multilingualism and Accessible Texts: Translation Practices in Some Italian Museums and a Proposal.” Journal of Translation Studies 1 (1): 59–86. Google Scholar logo with link to Google Scholar
Mayer, Richard E. 2005. “Cognitive Theory of Multimedia Learning.” In The Cambridge Handbook of Multimedia Learning, edited by Richard E. Mayer, 31–48. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Mayr, Eva, Kristin Knipfer, and Daniel Wessel. 2009. “In-Sights into Mobile Learning: An Exploration of Mobile Eye Tracking Methodology for Learning in Museums.” In Researching Mobile Learning: Frameworks, Tools and Research Designs, edited by Giasemi Vavoula, Norbert Pachler, and Agnes Kukulska-Hulme, 189–204. Oxford: Peter Lang.Google Scholar logo with link to Google Scholar
McManus, Paulette. 1991. “Making Sense of Exhibits.” In Museum Languages: Objects and Texts, edited by Gaynor Kavanagh, 33–46. Leicester: Leicester University Press. Google Scholar logo with link to Google Scholar
Milekic, Slavko. 2003. “The More You Look the More You Get: Intention-based Interface Using Gaze Tracking.” In Museums and the Web: Selected Papers from Museums and the Web 03, edited by David Bearman and Jennifer Trant. Pittsburgh: Archives & Museum Informatics. [URL]
. 2010. “Gaze Tracking and Museums: Current Research and Implications.” In Museums and the Web 2010: Proceedings, edited by Jennifer Trant and David Bearman. Toronto: Archives & Museum Informatics. [URL]
Morantes, Paola Patricia Parra, Sonia Andrea Peñarete, Giovanny Arbelaez, Mauricio Camargo, and Laurent Dupont. 2016. “Understanding Museum Visitors’ Experience through an Eye Tracking Study and a Living Lab Approach.” 22nd ICE/IEEE International Technology Management Conference. Trondheim: Norway. Google Scholar logo with link to Google Scholar
Neather, Robert. 2008. “Translating Tea: On the Semiotics of Interlingual Practice in the Hong Kong Museum of Teaware.” Meta 53 (1): 218–240. Google Scholar logo with link to Google Scholar
. 2021. “Museums as Translation Zones.” In The Routledge Handbook of Translation and Globalization, edited by Esperança Bielsa and Dionysios Kapsaskis, 306–319. Cham: Springer.Google Scholar logo with link to Google Scholar
Ng, Tzi-Dong Jeremy, Xiao Hu, and Ying Peng Que. 2022. “Towards Multi-modal Evaluation of Eye tracked Virtual Heritage Environment.” LAK22: 12th International Learning Analytics and Knowledge Conference, 451–457. Google Scholar logo with link to Google Scholar
Nitzke, Jean. 2021. “The Processing of Website Contents in Native and Nonnative Language.” In Translation, Interpreting, Cognition: The Way out of the Box, edited by Tra&Co Group, 105–113. Berlin: Language Science. Google Scholar logo with link to Google Scholar
Paivio, Allan. 1979. Imagery and Verbal Processes. 1st ed. New York: Psychology Press. Google Scholar logo with link to Google Scholar
Raffi, Francesca. 2017. “Full Access to Cultural Spaces (FACS): Mapping and Evaluating Museum Access Services Using Mobile Eye Tracking Technologies.” Ars Aeterna 9 (2): 18–37. Google Scholar logo with link to Google Scholar
Rainoldi, Mattia, Barbara Neuhofer, and Mario Jooss. 2018. “Mobile Eyetracking of Museum Learning Experiences.” In Information and Communication Technologies in Tourism 2018, edited by Brigitte Stangl and Juho Pesonen, 473–485. Cham: Springer. Google Scholar logo with link to Google Scholar
Rainoldi, Mattia, Chung-En Yu, and Barbara Neuhofer. 2020. “The Museum Learning Experience Through the Visitors’ Eyes: An Eye Tracking Exploration of the Physical Context.” In Eye Tracking in Tourism, edited by Mattia Rainoldi and Mario Jooss, 183–199. Cham: Springer. Google Scholar logo with link to Google Scholar
Reitstätter, Luise, Karolin Galter, and Flora Bakondi. 2022. “Looking to Read: How Visitors Use Exhibit Labels in the Art Museum.” Visitor Studies 25 (2): 127–150. Google Scholar logo with link to Google Scholar
Rentschler, Ruth, and Anne-Marie Hede. 2007. Museum Marketing: Competing in the Global Marketplace. Oxford: Butterworth-Heinemann.Google Scholar logo with link to Google Scholar
Schiele, Bernard. 1995. “Text in the Exhibition Medium.” In Text in the Exhibition Medium, edited by Alexandre Blais, 33–47. La Société Des Musées Québécois: Musée de la civilisation.Google Scholar logo with link to Google Scholar
Schwan, Stephan, Melissa Gussmann, Peter Gerjets, Axel Drecoll, and Albert Feiber. 2020. “Distribution of Attention in a Gallery Segment on the National Socialists’ Führer Cult: Diving Deeper into Visitors’ Cognitive Exhibition Experiences Using Mobile Eye Tracking.” Museum Management and Curatorship 35 (1): 71–88. Google Scholar logo with link to Google Scholar
Severin, Werner. 1967. “Another Look at Cue Summation.” AV Communication Review 15 (4): 233–245. Google Scholar logo with link to Google Scholar
Smith, Jeffrey K., and Smith, Lisa F. 2001. “Spending Time on Art.” Empirical Studies of the Arts 19 (2): 229–236. Google Scholar logo with link to Google Scholar
Smith, Lisa F., Jeffrey K. Smith and Pablo P. L. Tinio. 2017. “Time Spent Viewing Art and Reading Labels.” Psychology of Aesthetics, Creativity, and the Arts 11 (1): 77–85. Google Scholar logo with link to Google Scholar
Spinzi, Cinzia. 2019. “A Cross-Cultural Study of Figurative Language in Museum Audio Descriptions. Implications for Translation.” Lingue e Linguaggi 331: 303–316. Google Scholar logo with link to Google Scholar
Sturge, Kate. 2007. Representing Others: Translation, Ethnography and Museum. Manchester: St Jerome Publishing.Google Scholar logo with link to Google Scholar
Szarkowska, Agnieszka, Izabela Krejtz, Krzysztof Krejtz, and Andrew Duchowski. 2013. “Harnessing the Potential of Eyetracking for Media Accessibility.” In Translation Studies and Eye Tracking Analysis, edited by Sambor Grucza, Monika Pluzyczka, and Justyna Zajac, 153–183. Oxford: Peter Lang.Google Scholar logo with link to Google Scholar
Yang, Jing, and Cyrus Yin-Ho Chan. 2019. “Audio-augmented Museum Experiences with Gaze Tracking.” Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia 461, 1–5. Google Scholar logo with link to Google Scholar
Cited by (1)

Cited by one other publication

Pierroux, Palmyre
2024. Innovating visitor research within museums: Concepts, tools and practices. Multimodality & Society 4:3 ► pp. 275 ff. DOI logo

This list is based on CrossRef data as of 5 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue