Cover not available

Article published In: Methodological Issues in Experimental Research in Audiovisual Translation and Media Accessibility
Edited by Gian Maria Greco, Anna Jankowska and Agnieszka Szarkowska
[Translation Spaces 11:1] 2022
► pp. 113–133

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
EPUB logo with download linkDownload EPUB
authorization required

Preparing and comparing subtitles for quasi-experimental and experimental research in audiovisual translation studies

ORCiD logo with link | University of Antwerp
 | University of Antwerp
 | University of Antwerp
Published online: 19 July 2022
DOI logo with link
https://doi.org/10.1075/ts.21038.van
Abstract
Empirical research on cognitive processing in AVT has been on the rise in recent years. A number of overarching works have recommended more standardised approaches and methodological frameworks to contribute to more streamlined, replicable, reproducible and valid future AVT research. To date, the issue of comparability of research materials (e.g., clips, subtitle tracks, comprehension questionnaires) and, more specifically, how to achieve comparability in quasi-experimental and experimental studies, particularly those involving repeated measures, has received little attention. This paper aims to address this knowledge gap by proposing a common-sense ten-step preparatory process for quasi-experimental and experimental subtitling studies. This preparatory process has previously been used in the S4AE project. The paper will focus on the final four steps, consisting of the preparation and comparison of multiple subtitle tracks. These steps were conceptualized taking into account the present research on subtitle parameters and the obstacles encountered while preparing comparable subtitle tracks.
Article outline
  • 1.Introduction
  • 2.Theoretical framework
  • 3.Project background
  • 4.The ten steps
    • 4.1The first six steps
    • 4.2Step 7: Production of comparable subtitles
    • 4.3Step 8: Subtitle analyses
    • 4.4Step 9: Third pilot study with subtitles
    • 4.5Step 10: Finalisation of materials
  • 5.Conclusion
  • Note
  • References
References (37)
References
Brysbaert, Marc, and Boris New. 2009. “Moving beyond Kucera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English.” Behavior Rsearch Methods 41(4): 977–990. Google Scholar logo with link to Google Scholar
Clifton, Charles, Adrian Staub, and Keith Rayner. 2007. “Eye movements in reading words and sentences.” In Eye movements: A window on mind and brain, edited by Roger P. G. Van Gompel, Martin H. Fischer, Wayne S. Murray, and Robin L. Hill, 341–371. Amsterdam: Elsevier. Google Scholar logo with link to Google Scholar
Díaz Cintas, Jorge. 2003. Teoría y práctica de la subtitulación: Inglés-Español. Barcelona: Ariel.Google Scholar logo with link to Google Scholar
. 2020. “Audiovisual translation.” In The Bloomsbury Companion to Language Industry Studies, edited by Erik Angelone, Maureen Ehrensberger-Dow, and Gary Massey, 209–230. London: Bloomsbury. Google Scholar logo with link to Google Scholar
Díaz Cintas, Jorge, and Aline Remael. 2014. Audiovisual Translation: Subtitling. Manchester: St Jerome. Google Scholar logo with link to Google Scholar
Doherty, Stephen, and Jan-Louis Kruger. 2018. “The development of eye tracking in empirical research on subtitling and captioning.” In Seeing into screens: Eye tracking and the moving image, edited by Tessa Dwyer, Claire Perkins, Sean Redmond, and Jodi Sita, 46–56. London: Bloomsbury. Google Scholar logo with link to Google Scholar
d’Ydewalle, Géry, and Wim De Bruycker. 2007. “Eye movements of children and adults while reading television subtitles.” European Psychologist 12(3): 196–205. Google Scholar logo with link to Google Scholar
d’Ydewalle, Géry, Johan Van Rensberger, and Joris Pollet. 1987. “Reading a message when the same message is available auditorily in another language: The case of subtitling.” In Eye Movements from Physiology to Cognition, edited by J. Kevin O’Regan, and Araine Lévy-Schoen, 313–321. Amsterdam: Elsevier. Google Scholar logo with link to Google Scholar
Fresno, Nazaret, and Katarzyna Sepielak. 2020. “Subtitling speed in Media Accessibility research: Some methodological considerations.” Perspectives. Google Scholar logo with link to Google Scholar
Gottlieb, Henrik. 2012. “Subtitles: Readable dialogue?” In Eye tracking in audiovisual translation, edited by Elisa Perego, 37–82. Rome: Aracne.Google Scholar logo with link to Google Scholar
Hefer, Esté. 2013. “Reading first and second language subtitles: Sesotho viewers reading in Sesotho and English.” Southern African Linguistics and Applied Language Studies 31(3): 359–373. Google Scholar logo with link to Google Scholar
Ivarsson, Jan, and Mary Carroll. 1998. Subtitling. Simrishamn: TransEdit.Google Scholar logo with link to Google Scholar
Karamitroglou, Fotios. 1998. “A proposed set of subtitling standards in Europe.” Translation Journal 2(2).Google Scholar logo with link to Google Scholar
Keuleers, Emmanuel, Marc Brysbaert, and Boris New. 2010. “Subtlex-NL: A new measure for Dutch word frequency based on film subtitles.” Behavior Research Methods 42(3): 643–650. Google Scholar logo with link to Google Scholar
Kidwell, Paul, Guy Lebanon, and Kevyn Collins-Thompson. 2011. “Statistical estimation of word acquisition with application to readability prediction.” Journal of the American Statistical Association 106(493): 21–30. Google Scholar logo with link to Google Scholar
Kraf, Roger, and Henk Pander. 2009. “Leesbaarheidsonderzoek: Oude problemen, nieuwe kansen [Readability research: Old problems, new opportunities].” Tijdschrift voor Taalbeheersing 31(2): 97–123. Google Scholar logo with link to Google Scholar
Kruger, Jan-Louis, and Stephen Doherty. 2016. “Measuring cognitive load in the presence of educational video: Towards a multimodal methodology.” Australasian Journal of Educational Technology 32(6): 19–31. Google Scholar logo with link to Google Scholar
Kruger, Jan-Louis, Esté Hefer, and Gordon Matthew. 2014. “Attention distribution and cognitive load in a subtitled academic lecture: L1 vs. L2.” Journal of Eye Movement Research 7(5): 1–15. Google Scholar logo with link to Google Scholar
Kruger, Jan-Louis, María T. Soto-Sanfiel, Stephen Doherty, and Ronny Ibrahim. 2016. “Towards a cognitive audiovisual translatology.” In Reembedding Translation Process Research, edited by Ricardo Muñoz Martín, 171–193. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Kruger, Jan-Louis, and Faans Steyn. 2014. “Subtitles and eye tracking: Reading and performance.” Reading Research Quarterly 49(1): 105–120. Google Scholar logo with link to Google Scholar
Kruger, Jan-Louis, Agnieszka Szarkowska, and Izabela Krejtz. 2015. “Subtitles on the moving image: An overview of eye tracking studies.” Refractory: A Journal of Entertainment Media 251: 1–14.Google Scholar logo with link to Google Scholar
Kruger, Jan-Louis, Natalia Wisniewksa, and Sixin Liao. 2022. “Why subtitle speed matters: Evidence from word skipping and rereading.” Applied Psycholinguistics 43(1): 211–236. Google Scholar logo with link to Google Scholar
Lavaur, Jean-Marc, and Dominique Bairstow. 2011. “Languages on the screen: Is film comprehension related to the viewers’ fluency level and to the language in the subtitles?” International Journal of Psychology 46(6): 455–462. Google Scholar logo with link to Google Scholar
Leppink, Jimmie, and Angelique van den Heuvel. 2015. “The evolution of cognitive load theory and its application to medical education.” Perspectives on Medical Education 4(3): 119–127. Google Scholar logo with link to Google Scholar
Liao, Sixin, Lili Yu, Erik D. Reichle, and Jan-Louis Kruger. 2021. “Using eye movements to study the reading of subtitles in video.” Scientific Studies of Reading 25(5): 417–435. Google Scholar logo with link to Google Scholar
Moran, Siobhan. 2012. “The effect of linguistic variation on subtitle reception.” In Eye tracking in audiovisual translation, edited by Elisa Perego, 37–82. Rome: Aracne.Google Scholar logo with link to Google Scholar
Orero, Pilar, Stephen Doherty, Jan-Louis Kruger, Anna Matamala, Jan Pedersen, Elisa Perego, Pablo Romero-Fresco, Sara Rovira-Esteva, Olga Soler-Vilageliu, and Agnieszka Szarkowska. 2018. “Conducting experimental research in audiovisual translation (AVT): A position paper.” The Journal of Specialised Translation 301: 105–126.Google Scholar logo with link to Google Scholar
Pedersen, Jan. 2017. The FAR model: Assessing quality in interlingual subtitling. The Journal of Specialised Translation 281: 210–229.Google Scholar logo with link to Google Scholar
Perego, Elisa. 2008. “Subtitles and line-breaks: Towards improved readability.” In Between Text and Image: Updating research in screen translation, edited by Delia Chiaro, Christine Heiss, and Chiara Bucaria, 211–223. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Perego, Elisa, Fabio Del Missier, and Marta Stragà. 2018. Dubbing vs. Subtitling: Complexity matters. Target 30(1): 137–157. Google Scholar logo with link to Google Scholar
Romero-Fresco, Pablo. 2009. “More haste less speed: Edited versus verbatim respoken subtitles.” Vial-vigo International Journal of Applied Linguistics 61: 109–133.Google Scholar logo with link to Google Scholar
Schotter, Elizabeth R., and Keith Rayner. 2012. “Eye movements in reading: Implications for reading subtitles.” In Eye tracking in audiovisual translation, edited by Elisa Perego, 83–104. Rome: Aracne.Google Scholar logo with link to Google Scholar
Szarkowska, Agnieszka, and Gerber-Morón, Oliva. 2018. “Viewers can keep up with fast subtitles: Evidence from eye movements.” PLoS One 13(6). Google Scholar logo with link to Google Scholar
Szarkowska, Agnieszka, Izabela Krejtz, Zuzanna Klyszejko, and Anna Wieczorek. 2011. “Verbatim, standard, or edited? Reading patterns of different captioning styles among deaf, hard of hearing and hearing viewers.” American Annals of the Deaf 156(4): 363–378. Google Scholar logo with link to Google Scholar
van Heuven, Walter J. B., Pawel Mandera, Emmanuel Keuleers, and Marc Brysbaert. 2014. “Subtlex-UK: A new and improved word frequency database for British English.” Quarterly Journal of Experimental Psychology 67(6): 1176–1190. Google Scholar logo with link to Google Scholar
Van Hoecke, Senne M., Iris Schrijver, and Isabelle S. Robert. 2022. “Methodological preparation of a within-subject audiovisual cognition, reception and perception study.” Journal of Audiovisual Translation, 5(1): 94–128. Google Scholar logo with link to Google Scholar
Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue