Cover not available

Article published In: Target
Vol. 37:3 (2025) ► pp.444–484

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
EPUB logo with download linkDownload EPUB
authorization required

Conducting replication in translation and interpreting studies

Stakeholders’ perceptions, practices, and expectations

ORCiD logo with link | National University of Singapore
ORCiD logo with link | Xiamen University
Published online: 19 May 2025
DOI logo with link
https://doi.org/10.1075/target.23164.han
Abstract
Replication has the potential to substantiate tentative research claims and consolidate the existing evidence base. Translation and interpreting (T&I) scholars have argued for the need for replication and generated initial data on practices and attitudes towards replication. In three inter-linked studies described in this article, we shed further light on how replication is perceived, practiced, and expected by relevant stakeholders. We find that (a) most of the T&I journal editors surveyed support replication, but give lower priority to direct replication; (b) the overall prevalence rate of replication was 0.6% among 3807 research articles published in eleven leading T&I journals (2000–2022), and most of the identified replications were partial replication; and (c) the majority of the T&I researchers who participated in this research expected their study to be replicated based on various alterations. These findings help us develop an enhanced understanding of replication and formulate strategies to promote replication in empirical T&I studies.
Article outline
  • 1.Introduction
  • 2.Replication from a theoretical perspective
    • 2.1Replication: Key concepts
    • 2.2Replication typology
    • 2.3Replication in empirical TIS
  • 3.Methodological considerations for the current study
    • 3.1Research gaps
    • 3.2Research questions
    • 3.3Method
      • 3.3.1Study 1: T&I journal editors’ perceptions of replication
      • 3.3.2Study 2: Practices of replication by T&I researchers
      • 3.3.3Study 3: T&I researchers’ expectations on future replication
  • 4.Results
    • 4.1RQ1: How do T&I journal editors perceive replications?
    • 4.2RQ2: To what extent and how have T&I researchers practiced replication in leading T&I journals?
    • 4.3RQ3: What aspects of research do T&I researchers expect to be altered in future replications?
  • 5.Discussion
  • 6.Concluding remarks
  • Note
  • References
  • References for Appendix 3
  • References for Appendix 4
References (88)
References
Allen, Mike, and Raymond Preiss. 1993. “Replication and Meta-analysis: A Necessary Connection.” Journal of Social Behavior & Personality 8 (6): 9–20.Google Scholar logo with link to Google Scholar
Asendorpf, Jens B., Mark Conner, Filip de Fruyt, Jan de Houwer, Jaap J. A. Denissen, Klaus Fiedler, Susann Fiedler, David C. Funder, Reinhold Kliegl, Brian A. Nosek, Marco Perugini, Brent W. Roberts, Manfred Schmitt, Marcel A. G. van Aken, Hannelore Weber, and Jelte M. Wicherts. 2013. “Recommendations for Increasing Replicability in Psychology.” European Association of Personality Psychology 27 (2): 108–119. Google Scholar logo with link to Google Scholar
Baker, Monya. 2015. “Over Half of Psychology Studies Fail Reproducibility Test.” Nature (2015). Google Scholar logo with link to Google Scholar
Brandt, Mark J., Hans Ijzerman, Ap Dijksterhuis, Frank J. Farach, Jason Geller, Roger Giner-Sorolla, James A. Grange, Marco Perugini, Jeffrey R. Spies, and Anna van’t Veer. 2014. “The Replication Recipe: What Makes for a Convincing Replication?” Journal of Experimental Social Psychology 501: 217–224. Google Scholar logo with link to Google Scholar
Bühler, Hildegund. 1986. “Linguistic (Semantic) and Extra-linguistic (Pragmatic) Criteria for the Evaluation of Conference Interpretation and Interpreters.” Multilingua 5–41: 231–235.Google Scholar logo with link to Google Scholar
Bunton, David. 2005. “The Structure of PhD Conclusion Chapters.” Journal of English for Academic Purposes 4 (3): 207–224. Google Scholar logo with link to Google Scholar
Cooper, Harris, Larry V. Hedges, and Jeffrey C. Valentine. 2019. “Potentials and Limitations of Research Synthesis.” In The Handbook of Research Synthesis and Meta-Analysis, edited by Harris Cooper, Larry V. Hedges, and Jeffrey C. Valentine, 517–525. New York: Russell Sage Foundation. Google Scholar logo with link to Google Scholar
Easley, Richard W., Charles S. Madden, and Mark G. Dunn. 2000. “Conducting Marketing Science: The Role of Replication in the Research Process.” Journal of Business Research 48 (1): 83–92. Google Scholar logo with link to Google Scholar
Flis, Gabriela, Adam Sikorski, and Agnieszka Szarkowska. 2020. “Does the Dubbing Effect Apply to Voice-over? A Conceptual Replication Study on Visual Attention and Immersion.” The Journal of Specialised Translation 331: 41–69.Google Scholar logo with link to Google Scholar
Ghiselli, Serena. 2022. “Working Memory Tasks in Interpreting Studies: A Meta-Analysis.” Translation, Cognition & Behavior 5 (1): 50–83. Google Scholar logo with link to Google Scholar
Gile, Daniel. 1990. “Scientific Research vs. Personal Theories in the Investigation of Interpretation.” In Aspects of Applied and Experimental Research on Conference Interpretation, edited by Laura Gran and Christopher Taylor, 28–41. Campanotte: Editore Udine.Google Scholar logo with link to Google Scholar
. 2006. “Conference Interpreting.” In Encyclopedia of Language and Linguistics, edited by Keith Brown, 9–23. Boston: Elsevier. Google Scholar logo with link to Google Scholar
. 2009. “Interpreting Studies: A Critical View from Within.” MonTI 11: 135–155. Google Scholar logo with link to Google Scholar
. 2011. “Preface.” In Advances in Interpreting Research, edited by Brenda Nicodemus and Laurie Swabey, vii–ix. Amsterdam: John Benjamins.Google Scholar logo with link to Google Scholar
. 2020. “The CIRIN Bulletin n°60.” [URL]
Hubbard, Raymond, and John S. Armstrong. 1994. “Replications and Extensions in Marketing — Rarely Published but Quite Contrary.” International Journal of Research in Marketing 111: 233–248. Google Scholar logo with link to Google Scholar
Hubbard, Raymond, and Daniel E. Vetter. 1996. “An Empirical Comparison of Published Replication Research in Accounting, Economics, Finance, Management, and Marketing.” Journal of Business Research 35 (2):153–164. Google Scholar logo with link to Google Scholar
Liu, Min-Hua. 2016. “Putting the Horse before the Cart: Righting the Experimental Approach in Interpreting Studies.” In Addressing Methodological Challenges in Interpreting Studies Research, edited by Claudio Bendazzoli and Claudia Monacelli, 87–105. Newcastle upon Tyne: Cambridge Scholars.Google Scholar logo with link to Google Scholar
. 2023. “User Expectations Research Revisited: Methodological Considerations.” In Introducing New Hypertexts on Interpreting (Studies): A Tribute to Franz Pöchhacker, edited by Cornelia Zwischenberger, Karin Reithofer, and Sylvi Rennert, 44–65. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Lykken, David T. 1968. “Statistical Significance in Psychological Research.” Psychological Bulletin 701: 151–159. Google Scholar logo with link to Google Scholar
Makel, Matthew C., and Jonathan A. Plucker. 2014. “Facts are More Important than Novelty: Replication in the Education Sciences.” Educational Researcher 43 (6): 304–316. Google Scholar logo with link to Google Scholar
Makel, Matthew C., Jonathan A. Plucker, and Boyd Hegarty. 2012. “Replications in Psychology Research: How Often do They Really Occur?” Perspectives in Psychological Science 71: 537–542. Google Scholar logo with link to Google Scholar
Marsden, Emma, Kara Morgan-Short, Sophie Thompson, and David Abugaber. 2018. “Replication in Second Language Research: Narrative and Systematic Reviews and Recommendations for the Field.” Language Learning 68 (2): 321–391. Google Scholar logo with link to Google Scholar
Mellinger, Christopher D., and Thomas A. Hanson. 2017. Quantitative Research Methods in Translation and Interpreting Studies. Abingdon: Routledge.Google Scholar logo with link to Google Scholar
. 2019. “Meta-Analyses of Simultaneous Interpreting and Working Memory.” Interpreting 21 (2): 165–195. Google Scholar logo with link to Google Scholar
. 2020. “Meta-Analysis and Replication in Interpreting Studies.” Interpreting 22 (1): 140–149. Google Scholar logo with link to Google Scholar
Orozco, Mariana. 2004. “The Clue to Common Research in Translation and Interpreting: Methodology.” In Translation Research and Interpreting Research: Traditions, Gaps, and Synergies, edited by Christina Schäffner, 98–103. London: Multilingual Matters. Google Scholar logo with link to Google Scholar
Patil, Prasad, Roger D. Peng, and Jeffrey T. Leek. 2016. “What Should Researchers Expect When They Replicate Studies? A Statistical View of Replicability in Psychological Science.” Perspectives on Psychological Science 11 (4): 539–544. Google Scholar logo with link to Google Scholar
Pöchhacker, Franz. 2011. “Replication in Research on Quality in Conference Interpreting.” T&I Review 11: 35–57.Google Scholar logo with link to Google Scholar
Polio, Charlene, and Susan Gass. 1997. “Replication and Reporting: A Commentary.” Studies in Second Language Acquisition 191: 499–508. Google Scholar logo with link to Google Scholar
Porte, Graeme, and Keith Richards. 2012. “Replication in Second Language Writing Research.” Journal of Second Language Writing 211: 284–293. Google Scholar logo with link to Google Scholar
Porte, Graeme. 2012. Replication Research in Applied Linguistics. Cambridge: Cambridge University Press.Google Scholar logo with link to Google Scholar
Rosenthal, Robert. 1991. “Replication in Behavioral Research.” In Replication Research in the Social Sciences, edited by James W. Neuliep, 1–39. Newbury Park: Sage.Google Scholar logo with link to Google Scholar
. 1997. “Some Issues in the Replication of Social Science Research.” Labour Economics 41: 121–123. Google Scholar logo with link to Google Scholar
Saldanha, Gabriela, and Sharon O’Brien. 2013. Research Methodologies in Translation Studies. Abingdon: Routledge.Google Scholar logo with link to Google Scholar
Schmidt, Stefan. 2009. “Shall We Really Do it Again? The Powerful Concept of Replication is Neglected in the Social Sciences.” Review of General Psychology 131: 90–100. Google Scholar logo with link to Google Scholar
Stroebe, Wolfgang, and Fritz Strack. 2014. “The Alleged Crisis and the Illusion of Exact Replication.” Perspectives on Psychological Science 91: 59–71. Google Scholar logo with link to Google Scholar
Valentine, Jeffrey C., Anthony Biglan, Robert F. Boruch, Felipe González Castro, Linda M. Collins, Brian R. Flay, Sheppard Kellam, Eve K. Mościcki, and Steven P. Schinke. 2011. “Replication in Prevention Science.” Prevention Science 121: 103–117. Google Scholar logo with link to Google Scholar
References for Appendix 3
Buchweitz, Augusto, and Fabio Alves. 2006. “Cognitive Adaptation in Translation: An Interface between Language Direction, Time, and Recursiveness in Target Text Production.” Letras de Hoje 411: 241–272.Google Scholar logo with link to Google Scholar
Colina, Sonia. 2008. “Translation Quality Evaluation: Empirical Evidence for a Functionalist Approach.” The Translator 14 (1): 97–134. Google Scholar logo with link to Google Scholar
Dam, Helle Vrønning, and Karen Korning Zethsen. 2011. “The Status of Professional Business Translators on the Danish Market: A Comparative Study of Company, Agency and Freelance Translators.” Meta 56 (4): 976–997. Google Scholar logo with link to Google Scholar
Dam, Helle Vrønning. 2004. “Interpreters’ Notes: On the Choice of Language.” Interpreting 6 (1): 3–17. Google Scholar logo with link to Google Scholar
Fernández-Torné, Anna, and Anna Matamala. 2015. “Text-to-Speech vs. Human Voiced Audio Descriptions: A Reception Study in Films Dubbed into Catalan.” The Journal of Specialised Translation 241: 61–88.Google Scholar logo with link to Google Scholar
González Davies, Maria. 2014. “Towards a Plurilingual Development Paradigm: From Spontaneous to Informed Use of Translation in Additional Language Learning.” The Interpreter and Translator Trainer 8 (1): 8–31. Google Scholar logo with link to Google Scholar
Han, Chao. 2015a. “(Para)linguistic Correlates of Perceived Fluency in English-to-Chinese Simultaneous Interpretation.” International Journal of Comparative Literature and Translation Studies 3 (4): 32–37.Google Scholar logo with link to Google Scholar
. 2015b. “Lacunae, Myths and Legends about Conference Interpreters: A Diary Study to Explore Conference Interpreting Practice in China.” Perspectives 23 (3): 440–457. Google Scholar logo with link to Google Scholar
Kobayashi, Masatomo, Trisha O’Connell, Bryan Gould, Hironobu Takagi, and Chieko Asakawa. 2010. “Are Synthesized Video Descriptions Acceptable?” In Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility. October, 2010, Orlando, Florida, USA. 163–170. Google Scholar logo with link to Google Scholar
Laviosa, Sara. 1998a. “Core Patterns of Lexical Use in a Comparable Corpus of English Narrative Prose.” Meta 43 (4): 557–570. Google Scholar logo with link to Google Scholar
. 1998b. “The English Comparable Corpus: A Resource and a Methodology.” In Unity in Diversity? Current Trends in Translation Studies, edited by Lynne Bowker, Michael Cronin, Dorothy Kenny, and Jennifer Pearson, 101–112. Manchester: St. Jerome.Google Scholar logo with link to Google Scholar
Makel, Matthew C., Jonathan A. Plucker, and Boyd Hegarty. 2012. “Replications in Psychology Research.” Perspectives on Psychological Science 7 (6): 537–542. Google Scholar logo with link to Google Scholar
Perego, Elisa, Fabio Del Missier, and Sara Bottiroli. 2015. “Dubbing versus Subtitling in Young and Older Adults: Cognitive and Evaluative Aspects.” Perspectives 23 (1): 1–21. Google Scholar logo with link to Google Scholar
Russo, Mariachiara, and Salvador Pippa. 2004. “Aptitude to Interpreting: Preliminary Results of a Testing Methodology Based on Paraphrase.” Meta 49 (2): 409–432. Google Scholar logo with link to Google Scholar
Sandrelli, Annalisa, and Claudio Bendazzoli. 2005. “Lexical Patterns in Simultaneous Interpreting: A Preliminary Investigation of EPIC (European Parliament Interpreting Corpus).” Proceedings of the Corpus Linguistics Conference Series. [URL]
Szarkowska, Agnieska. 2011. “Text-to-Speech Audio Description: Towards Wider Availability of AD.” The Journal of Specialised Translation 151: 142–162.Google Scholar logo with link to Google Scholar
Tirkkonen-Condit, Sonja. 2004. “Unique Items — Over- or Under-Represented in Translated Language?” In Translation Universals: Do they Exist?, edited by Anna Mauranen and Pekka Kujamäki, 177–184. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Walczak, Agnieszka, and Louise Fryer. 2018. “Vocal Delivery of Audio Description by Genre: Measuring Users’ Presence.” Perspectives 26 (1): 69–83. Google Scholar logo with link to Google Scholar
Yamada, Masaru. 2014. “Can College Students be Post-Editors? An Investigation into Employing Language Learners in Machine Translation Plus Post-Editing.” Machine Translation 29 (1): 49–67. Google Scholar logo with link to Google Scholar
Yeh, Shu-Pai, and Min-Hua Liu. 2006. “A More Objective Approach to Interpretation Evaluation: Exploring the Use of Scoring Rubrics.” Compilation and Translation Review 34 (4): 57–78.Google Scholar logo with link to Google Scholar
Yenkimaleki, Mahmood, and Vincent J. van Heuven. 2016. “The Effect of Prosody Awareness Training on the Performance of Consecutive Interpretation by Farsi-English Interpreter Trainees: An Experimental Study.” Asia Pacific Translation and Intercultural Studies 3 (3): 235–251. Google Scholar logo with link to Google Scholar
Yeung, Andy W. K. 2017. “Do Neuroscience Journals Accept Replications? A Survey of Literature.” Frontiers in Human Neuroscience 111: 1–6. Google Scholar logo with link to Google Scholar
References for Appendix 4
Ameri, Saeed, Masood Khoshsaligheh, and Ali Khazaee Farid. 2018. “The Reception of Persian Dubbing: A Survey on Preferences and Perception of Quality Standards in Iran.” Perspectives 26 (3): 435–451. Google Scholar logo with link to Google Scholar
Conde, Tomás. 2011. “Translation Evaluation on the Surface of Texts: A Preliminary Analysis.” The Journal of Specialised Translation 151: 69–86.Google Scholar logo with link to Google Scholar
Deng, Weitian. 2020. “The Dual Effect of Speakers’ Silent Pauses on Fluent Simultaneous Interpreting: A Comparison Between Formal Speech and Spontaneous Speech.” Across Languages and Cultures 21 (2): 241–264. Google Scholar logo with link to Google Scholar
Hale, Sandra, Jane Goodman-Delahunty, and Natalie Martschuk. 2019. “Interpreter Performance in Police Interviews: Differences between Trained Interpreters and Untrained Bilinguals.” The Interpreter and Translator Trainer 13 (2): 107–131. Google Scholar logo with link to Google Scholar
Han, Chao, and Mehdi Riazi. 2017. “Investigating the Effects of Speech Rate and Accent on Simultaneous Interpretation: A Mixed-Methods Approach.” Across Languages and Cultures 18 (2): 237–259. Google Scholar logo with link to Google Scholar
Rossetti, Alessandra, and Sharon O’Brien. 2019. “Helping the Helpers: Evaluating the Impact of a Controlled Language Checker on the Intralingual and Interlingual Translation Tasks Involving Volunteer Health Professionals.” Translation Studies 12 (2): 253–271. Google Scholar logo with link to Google Scholar
Schaeffer, Moritz, Jean Nitzke, Anke Tardel, Katharina Oster, Silke Gutermuth, and Silvia Hansen-Schirra. 2019. “Eye-Tracking Revision Processes of Translation Students and Professional Translators.” Perspectives 27 (4): 589–603. Google Scholar logo with link to Google Scholar
Su, Wenchao, and Defeng Li. 2019. “Identifying Translation Problems in English-Chinese Sight Translation: An Eye-Tracking Experiment.” Translation and Interpreting Studies 14 (1): 110–134. Google Scholar logo with link to Google Scholar
Terryn, Ayla Rigouts, Isabelle S. Robert, Jim J. J. Ureel, Aline Remael, and Sabien Hanoulle. 2017. “Conceptualizing Translation Revision Competence: A Pilot Study on the Acquisition of the Knowledge about Revision and Strategic Subcompetences.” Across Languages and Cultures 18 (1): 1–27. Google Scholar logo with link to Google Scholar
Tor-Carroggio, Irene. 2020. “T(ime) T(o) S(tart) Synthesising Audio Description in China? Results of a Reception Study.” The Journal of Specialised Translation 341: 171–191.Google Scholar logo with link to Google Scholar
Walczak, Agnieszka, and Louise Fryer. 2018. “Vocal Delivery of Audio Description by Genre: Measuring Users’ Presence.” Perspectives 26 (1): 69–83. Google Scholar logo with link to Google Scholar
Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue