Cover not available

Article published In: Target
Vol. 32:3 (2020) ► pp.389–419

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
authorization required

Multimodal corpus analysis of subtitling

The case of non-standard varieties

ORCiD logo with link | University of Leeds
 | University of Hafr Al Batin
Published online: 20 February 2020
DOI logo with link
https://doi.org/10.1075/target.18085.ram
Abstract
This article proposes a new methodology for multimodal corpus analysis. It does so by particularly focusing on the issue of the translation of non-standard language varieties. This new methodology, which is significantly influenced by the work of Iedema, Rick. 2003. “Multimodality, Resemiotization: Extending the Analysis of Discourse as Multi-semiotic Practice.” Visual Communication 2 (1): 29–57. Google Scholar logo with link to Google Scholar, Jiménez Hurtado, Catalina, and Silvia Soler Gallego. 2013. “Multimodality, Translation and Accessibility: A Corpus-based Study of Audio Description.” Perspectives 21 (4): 577–594. Google Scholar logo with link to Google Scholar, Pastra, Katerina. 2008. “COSMOROE: A Cross-Media Relations Framework for Modelling Multimedia Dialectics.” Multimedia Systems 141: 299–323. Google Scholar logo with link to Google Scholar and . 2018. “Film, Dialects and Subtitles: An Analytical Framework for the Study of Non-standard Varieties in Subtitling.” The Translator 24 (1): 17–34. Google Scholar logo with link to Google Scholar, is capable of identifying the modes and resources at play and the relations identified between them, as well as how such relations participate in the construction of the non-standard varieties’ communicative meaning. It also accounts for the impact of the introduction of subtitles on preserving, cancelling or modifying the intermodal relations identified in the source text and, consequently, the diegetic functions they support; that is, the function they assume in the fictional world of the film. In this regard, the methodology assumes a clear translational perspective.
Article outline
  • 1.Introduction
  • 2.Subtitling of linguistic varieties
  • 3.Corpus analysis of subtitled films with non-standard discourse
    • 3.1Corpus
    • 3.2Textual dimension
    • 3.3Diegetic dimension
  • 4.Concluding remarks
  • Notes
  • References
References (52)
References
Antonini, Rachele. 2005. “The Perception of Subtitled Humor in Italy.” Humor 18 (2): 209–225. Google Scholar logo with link to Google Scholar
Baldry, Anthony, and Paul Thibault. 2006. Multimodal Transcription and Text Analysis: A Multimedia Toolkit and Coursebook with Associated On-line Course. London: Equinox.Google Scholar logo with link to Google Scholar
Baños, Rocio. 2013. “‘That Is So Cool’: Investigating the Translation of Adverbial Intensifiers in English-Spanish Dubbing through a Parallel Corpus of Sitcoms.” Perspectives 21 (4): 526–542. Google Scholar logo with link to Google Scholar
Bateman, John. 2014. Text and Image: A Critical Introduction to the Visual/Verbal Divide. London: Routledge. Google Scholar logo with link to Google Scholar
Bateman, John, and Chiaoi Tseng. 2015. “The Establishment of Interpretative Expectations in Film.” In Multimodality and Cognitive Linguistics, edited by María Pinar Sanz, 131–146. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Blake, Norman. 1981. Non-standard Language in English Literature. London: Andre Deutsch.Google Scholar logo with link to Google Scholar
Bordwell, David, and Kristin Thompson. (1979) 2008. Film Art: An Introduction. New York: McGraw-Hill.Google Scholar logo with link to Google Scholar
Brodovich, Olga. 1997. “Translation Theory and Non-standard Speech in Fiction.” Perspectives 5 (1): 25–30. Google Scholar logo with link to Google Scholar
Brisset, Annie. 1996. A Sociocritique of Translation: Theatre and Alterity in Quebec, 1968–1988. Toronto: University of Toronto Press.Google Scholar logo with link to Google Scholar
Bucaria, Chiara, and Delia Chiaro. 2007. “End-User Perception of Screen Translation: The Case of Italian Dubbing.” TradTerm 131: 91–118. Google Scholar logo with link to Google Scholar
Bucaria, Chiara. 2008. “Acceptance of the Norm or Suspension of Disbelief? The Case of Formulaic Language in Dubbese.” In Between Text and Image: Updating Research in Screen Translation, edited by Delia Chiaro, Christine Heiss, and Chiara Bucaria, 149–164. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Chaume, Frederic. 2004. “Film Studies and Translation Studies: Two Disciplines at Stake in Audiovisual Translation.” Meta 49 (1): 12–24. Google Scholar logo with link to Google Scholar
Chiaro, Delia. 2007. “The Effect of Translation on Humour Response: The Case of Dubbed Comedy in Italy.” In Doubts and Directions in Translation Studies: Selected Contributions from the EST Congress Lisbon 2004, edited by Yves Gambier, Miriam Schlesinger, and Radegundis Stolze, 137–152. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
. 2008. “Where Have All the Varieties Gone? The Vicious Circle of the Disappearance Act in Screen Translations.” In Dialect for All Seasons, edited by Irmeli Helin, 9–25. Münster: Nodus Publikationen.Google Scholar logo with link to Google Scholar
Diaz-Cintas, Jorge. 2008. “Audiovisual Translation Comes of Age.” In Between Text and Image. Updating Research in Screen Translation, edited by Delia Chiaro, Christine Heiss, and Chiara Bucaria, 1–9. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Dimitrova, Brigitta. 2002. “Orality, Literacy, Reproduction of Discourse and the Translation of Dialect.” In Dialektübersetzung und Dialekte im Multimedia, edited by Irmeli Helin, 121–139. Frankfurt: Peter Lang.Google Scholar logo with link to Google Scholar
Ellender, Claire. 2015. Dealing with Difference in Audiovisual Translation: Subtitling Linguistic Variation in Films. Oxford: Peter Lang. Google Scholar logo with link to Google Scholar
Freddi, Maria. 2013. “Constructing a Corpus of Translated Films: A Corpus View of Dubbing.” Perspectives 21 (4): 491–503. Google Scholar logo with link to Google Scholar
Fuentes Luque, Adrián. 2003. “An Empirical Approach to the Reception of AV Translated Humour.” The Translator 9 (2): 293–306. Google Scholar logo with link to Google Scholar
Gibson, James. 1979. The Ecological Approach to Visual Perception. Boston, MA: Houghton Mifflin.Google Scholar logo with link to Google Scholar
Hatim, Basil, and Ian Mason. 1990. Discourse and the Translator. London: New York: Longman.Google Scholar logo with link to Google Scholar
Hatim, Basil. 1990–1991. “Intertextuality and Idiolect as Intended Meaning; A Concern for Both Translator and Literacy Critic Alike: With Special Reference to Arabic.” Parallèles: Cahiers de l’École de Traduction et d’Interprétation de l’Université de Genève 121 (Hiver): 77–87.Google Scholar logo with link to Google Scholar
Hodson, Jane. 2014. Dialect in Film & Literature. London: Palgrave Macmillan. Google Scholar logo with link to Google Scholar
Iedema, Rick. 2003. “Multimodality, Resemiotization: Extending the Analysis of Discourse as Multi-semiotic Practice.” Visual Communication 2 (1): 29–57. Google Scholar logo with link to Google Scholar
Jimenez Hurtado, Catalina, and Claudia Seibel. 2012. “Multisemiotic and Multimodal Corpus Analysis in Audiodescription: TRACCE.” In Audiovisual Translation and Media Accessibility at the Crossroads, edited by Aline Remael, Pilar Orero, and Mary Carrol, 409–425. Amsterdam: Rodopi. Google Scholar logo with link to Google Scholar
Jiménez Hurtado, Catalina, and Silvia Soler Gallego. 2013. “Multimodality, Translation and Accessibility: A Corpus-based Study of Audio Description.” Perspectives 21 (4): 577–594. Google Scholar logo with link to Google Scholar
Kovačič, Irena. 1995. “Reception of Subtitles – The Non-existent Ideal Viewer.” Translatio (FIT Newsletter) 14 (3–4): 376–383.Google Scholar logo with link to Google Scholar
Kozloff, Sarah. 2000. Overhearing Film Dialogue. Berkeley, CA: University of California Press.Google Scholar logo with link to Google Scholar
Kress, Gunther, Carey Jewitt, Jon Ogbom, and Charalampos Tsatsarelis. 2001. Multimodal Teaching and Learning: The Rhetorics of the Science Classroom. London: Continuum.Google Scholar logo with link to Google Scholar
Künzli, Alexander, and Maureen Ehrensberger-Dow. 2011. “Innovative Subtitling: A Reception Study.” In Methods and Strategies of Process Research, edited by Cecilia Alvstad, Adelina Hild, and Elisabet Tiselius, 187–200. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Lemke, Jay. 1998. “Multiplying Meaning: Visual and Verbal Semiotics in Scientific Text.” In Reading Science: Critical and Functional Perspectives on Discourses of Science, edited by J. R. Martin and Robert Veel, 87–113. London: Routledge.Google Scholar logo with link to Google Scholar
Leppihalme, Ritva. 2000. “The Two Faces of Standardization: On the Translation of Regionalisms in Literary Dialogue.” The Translator 6 (2): 247–269. Google Scholar logo with link to Google Scholar
Mejdell, Gunvor. 2017. “ Et Dukkehjem in Arabic Translation.” Ibsen Studies 17 (1): 28–53. Google Scholar logo with link to Google Scholar
Mubaraki, Aishah. 2019. Representation and Subtitling of Linguistic Varieties in Egyptian Films. PhD diss. University of Leeds.Google Scholar logo with link to Google Scholar
Pastra, Katerina. 2008. “COSMOROE: A Cross-Media Relations Framework for Modelling Multimedia Dialectics.” Multimedia Systems 141: 299–323. Google Scholar logo with link to Google Scholar
Perego, Elisa, Fabio Del Missier, Marco Porta, and Mauro Mosconi. 2010. “The Cognitive Effectiveness of Subtitle Processing.” Media Psychology 131: 243–272. Google Scholar logo with link to Google Scholar
Pérez-González, Luís. 2014. Audiovisual Translation: Theories, Methods and Issues. Routledge: London. Google Scholar logo with link to Google Scholar
. 2010. Tradução no vazio: A variação linguística nas traduções portuguesas de Pygmalion, de Bernard Shaw, e My Fair Lady de Alan Jay Lerner . PhD diss. University of Lisbon.Google Scholar logo with link to Google Scholar
. 2018. “Film, Dialects and Subtitles: An Analytical Framework for the Study of Non-standard Varieties in Subtitling.” The Translator 24 (1): 17–34. Google Scholar logo with link to Google Scholar
Remael, Aline, Pilar Orero, and Mary Carroll. 2012. “Audiovisual Translation and Media Accessibility at the Crossroads.” In Audiovisual Translation and Media Accessibility at the Crossroads, edited by Aline Remael, Pilar Orero, and Mary Carrol, 13–22. Amsterdam: Rodopi. Google Scholar logo with link to Google Scholar
Rosa, Alexandra. 2004. Tradução, poder e ideologia: Retórica interpessoal no diálogo narrativo dickensiano em português (1950–1999). PhD diss. University of Lisbon.Google Scholar logo with link to Google Scholar
. 2015. “Translating Orality, Recreating Otherness.” Translation Studies 8 (2): 209–225. Google Scholar logo with link to Google Scholar
Shaw, Bernard. 1916. Pygmalion. London: Constable.Google Scholar logo with link to Google Scholar
Silvester, Hannah. 2018. “From Paratext to Polysemiotic Network: A Holistic Approach to the Study of Subtitled Films.” Linguistica Antverpiensia, New Series: Themes in Translation Studies 141: 71–83.Google Scholar logo with link to Google Scholar
Stöckl, Hartmut. 2004. “In Between Modes: Language and Image in Printed Media.” In Perspectives on Multimodality, edited by Eija Vetola, Cassily Charles, and Martin Kaltenbacher, 9–30. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Taylor, Christopher. 2003. “Multimodal Transcription in the Analysis: Translation and Subtitling of Italian films.” The Translator 9 (2): 191–205. Google Scholar logo with link to Google Scholar
Tuominen, Tiina. 2011. “Accidental Reading? Some Observations on the Reception of Subtitled Films.” In Audiovisual Translation in Close-up: Practical and Theoretical Approaches, edited by Adriana Serban, Anna Matamala, and Jean-Marc Lavaur, 189–204. Bern: Peter Lang.Google Scholar logo with link to Google Scholar
Valentini, Cristina. 2008. “Forlixt 1 – The Forlì Corpus of Screen Translation. Exploring Macrostructures.” In Between Text and Image. Updating Research in Screen Translation, edited by Delia Chiaro, Christine Heiss, and Chiara Bucaria, 37–50. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Yu, Jing. 2017. “Translating ‘Others’ as ‘Us’ in Huckleberry Finn: Dialect, Register and the Heterogeneity of Standard Language.” Language and Literature 26 (1): 54–65. Google Scholar logo with link to Google Scholar
Cited by (9)

Cited by nine other publications

Khusainova, Alfia
2024. Transferring the unfamiliar in Russian and Greek AVT. Translation and Translanguaging in Multilingual Contexts 10:3 ► pp. 303 ff. DOI logo
Lu, Siwen
2024. More than words: a multimodal analytical framework for studying the subtitling of swearwords. Perspectives 32:1 ► pp. 14 ff. DOI logo
Renna, Dora & Francesca Santulli
2024. Across languages, across media. A comparative analysis of linguistic variation in literary translation and transmedial adaptation of a Chinese-American fictional character. Diacrítica 37:3 ► pp. 153 ff. DOI logo
Valdeón, Roberto A.
2024. The translation of multimodal texts: challenges and theoretical approaches. Perspectives 32:1 ► pp. 1 ff. DOI logo
Wang, Bing
2024. Speech recognition using an english multimodal corpus with integrated image and depth information. Scientific Reports 14:1 DOI logo
Wu, Zhiwei
2024. Towards a corpus-based approach to graphic elements in creative subtitling. Babel. Revue internationale de la traduction / International Journal of Translation / Revista Internacional de Traducción 70:1-2 ► pp. 138 ff. DOI logo
Lu, Sijing
2023. Review of Dionísio da Silva & Radicioni (2022): Recharting Territories: Intradisciplinarity in Translation Studies. Babel. Revue internationale de la traduction / International Journal of Translation / Revista Internacional de Traducción 69:6 ► pp. 859 ff. DOI logo
Wang, Xi & Wenqi Zheng
2023. Zhang, Meifang and Feng, Dezheng (2021): Multimodal Approaches to Chinese-English Translation and Interpreting. New York: Routledge, 224 p.. Meta 68:1 ► pp. 211 ff. DOI logo
Raffi, Francesca
2022. Linguistic variation in Italian neorealist cinema: A multimodal analysis of subtitling. Cogent Arts & Humanities 9:1 DOI logo

This list is based on CrossRef data as of 4 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue