Use of statistical methods in translation and interpreting research
A longitudinal quantitative analysis of eleven peer-reviewed journals (2000–2020)
Published online: 23 May 2023
https://doi.org/10.1075/target.21132.han
https://doi.org/10.1075/target.21132.han
Abstract
The study reported on in the article examines the patterns and trends of statistical analysis in translation and
interpreting (T&I) research, based on a longitudinal quantitative analysis of more than 3300 research articles sampled from
eleven leading T&I journals (2000–2020). This evidence-based review is the first study to provide a systematic mapping of
statistical methods used by T&I researchers. Our analyses suggest that (a) about 40% of the articles use statistics, and the
use of statistics has been increasing over time; (b) the most frequently used inferential statistical techniques are the
t-test, Pearson’s correlation, and chi-squared test; and (c) although the use of statistical methods has
become increasingly diversified, about 90% of the methods used are basic-level statistics. We discuss these findings in relation
to statistical teaching and learning for relevant stakeholders, especially T&I researchers.
Article outline
- 1.Introduction
- 2.Categorization schemes for statistical methods
- 3.Statistics in T&I Studies
- 4.Research questions
- 5.Method
- 5.1T&I journals
- 5.2Article selection
- 5.3Coding scheme
- 5.4Coding procedure
- 5.5Data analysis
- 6.Results
- 6.1The extent of use of statistical methods
- 6.2Frequency of statistical use
- 6.3Diversity of statistical use
- 6.4The patterns of statistical use
- 6.5Statistical methods labeled ‘Others’
- 7.Discussion
- 8.Conclusion
- Notes
References
References (41)
Balling, Laura Winther. 2008. “A Brief Introduction to
Regression Designs and Mixed-Effects Modelling by a Recent Convert.” Copenhagen Studies in
Language 361: 175–192.
Balling, Laura Winther, and Kristian Tangsgaard Hvelplund. 2015. “Design
and Statistics in Quantitative Translation (Process)
Research.” In Translation as a Cognitive
Activity, edited by Fabio Alves, Amparo Hurtado Albir, and Isabel Lacruz, special
issue of Translation
Spaces 4 (1): 169–186.
Blanca, María J., Rafael Alarcón, and Roser Bono. 2018. “Current
Practices in Data Analysis Procedures in Psychology: What Has Changed?” Frontiers in
Psychology 91: 2558.
Carl, Michael, Srinivas Bangalore, and Moritz Schaeffer, eds. 2016. New
Directions in Empirical Translation Process Research: Exploring the CRITT
TPR-DB. Cham: Springer.
De Sutter, Gert, and Marie-Aude Lefer. 2020. “On
the Need for a New Research Agenda for Corpus-Based Translation Studies: A Multi-Methodological, Multifactorial and
Interdisciplinary
Approach.” Perspectives 28 (1): 1–23.
Eyckmans, June, Philippe Anckaert, and Winibert Segers. 2009. “The
Perks of Norm-Referenced Translation Evaluation.” In Testing and
Assessment in Translation and Interpreting Studies: A Call for Dialogue between Research and
Practice, edited by Claudia V. Angelelli and Holly E. Jacobson, 73–93. Amsterdam: John Benjamins.
Franco Aixelá, Javier. 2001–2022. BITRA –
Bibliography of Interpreting and Translation. Open-access database. [URL]
Gile, Daniel. 1998. “Observational
Studies and Experimental Studies in the Investigation of Conference
Interpreting.” Target 10 (1): 69–93.
. 2009. “Interpreting
Studies: A Critical View from within.” In A (Self-)Critical
Perspective of Translation Theories, edited by Àfrica Vidal and Javier France, special
issue
of MonTI 11: 135–155.
Gile, Daniel, Helle V. Dam, Friedel Dubslaff, Bodil Martinsen, and Anne Schjoldager, eds. 2001. Getting
Started in Interpreting Research: Methodological Reflections, Personal Accounts and Advice for
Beginners. Amsterdam: John Benjamins.
Goodwin, Laura D., and William L. Goodwin. 1985. “Statistical
Techniques in AERJ Articles, 1973–1983: The Preparation of Graduate Students to Read the Educational Research
Literature.” Educational
Researcher 14 (2): 5–11.
Han, Chao. 2016. “Reporting
Practices of Rater Reliability in Interpreting Research: A Mixed-Methods Review of 14 Journals
(2004–2014).” In Mixed Methods, edited
by Anna Kuznik and Joan Miquel Verd, special issue
of Journal of Research Design and Statistics in Linguistics and Communication
Science 3 (1): 49–75.
. 2017. “Using
Analytic Rating Scales to Assess English/Chinese Bi-Directional Interpreting: A Longitudinal Rasch Analysis of Scale Utility
and Rater Behavior.” In Translator Quality – Translation Quality:
Empirical Approaches to Assessment and Evaluation, edited by Geoffrey S. Koby and Isabel Lacruz, special
issue of Linguistica Antverpiensia, New Series – Themes in Translation
Studies 161: 196–215.
. 2018. “Mixed-Methods
Research in Interpreting Studies: A Methodological Review
(2004–2014).” Interpreting 20 (2): 155–187.
. 2019. “A
Generalizability Theory Study of Optimal Measurement Design for A Summative Assessment of English/Chinese Consecutive
Interpreting.” Language
Testing 36 (3): 419–438.
. 2022. “Interpreting
Testing and Assessment: A State-of-the-art Review.” Language
Testing 39 (1): 30–55.
Han, Chao, and Xiaoqi Shang. 2023. “An
Item-based, Rasch-Calibrated Approach to Assessing Translation
Quality.” Target 35 (1): 63–96.
Jenkins, Stephen J., Dale R. Fuqua, and Thomas C. Froehle. 1984. “A
Critical Examination of Use of Non-Parametric Statistics in the Journal of Counseling
Psychology.” Perceptual and Motor
Skills 59 (1): 31–35.
Khany, Reza, and Khalil Tazik. 2019. “Levels
of Statistical Use in Applied Linguistics Research Articles: From 1986 to 2015.” Journal of
Quantitative
Linguistics 26 (1): 48–65.
Larson-Hall, Jenifer. 2015. A
Guide to Doing Statistics in Second Language Research Using SPSS and R. 2nd
ed. New York: Routledge.
Liu, Minhua. 2011. “Methodology
in Interpreting Studies: A Methodological Review of Evidence-Based
Research.” In Advances in Interpreting Research: Inquiry in
Action, edited by Brenda Nicodemus and Laurie Swabey, 85–119. Amsterdam: Johan Benjamins.
. 2016. “Putting
the Horse before the Cart: Righting the Experimental Approach in Interpreting
Studies.” In Addressing Methodological Challenges in Interpreting
Studies Research, edited by Claudio Bendazzoli and Claudia Monacelli, 87–105. Newcastle upon Tyne: Cambridge Scholars.
Marco, Josep. 2009. “Training
Translation Researchers: An Approach Based on Models and Best Practice.” The Interpreter and
Translator
Trainer 3 (1): 13–35.
Mason, Ian. 2009. “Research
Training in Translation Studies.” The Interpreter and Translator
Trainer 3 (1): 1–12.
Mead, Peter. 2001. “Doctoral
Work on Interpretation: A Supervisee’s Perspective.” In Getting
Started in Interpreting Research: Methodological Reflections, Personal Accounts and Advice for
Beginners, edited by Daniel Gile, Helle V. Dam, Friedel Dubslaff, Bodil Martinsen, and Anne Schjoldager, 121–144. Amsterdam: John Benjamins.
Meister, Lova. 2018. “On
Methodology: How Mixed Methods Research Can Contribute to Translation Studies.” Translation
Studies 11 (1): 66–83.
Mellinger, Christopher D., and Thomas A. Hanson. 2017. Quantitative
Research Methods in Translation and Interpreting
Studies. Abingdon: Routledge.
. 2019. “Meta-Analyses
of Simultaneous Interpreting and Working
Memory.” Interpreting 21 (2): 165–195.
. 2020. “Methodological
Considerations for Survey Research: Validity, Reliability, and Quantitative
Analysis.” In Cognitive Translation Studies – Theoretical Models and
Methodological Criticism, edited by Ricardo Muñoz Martín and Kairong Xiao, special
issue of Linguistica Antverpiensia, New Series – Themes in Translation
Studies 191: 172–190.
Muñoz Martín, Ricardo, Sanjun Sun, and Defeng Li. 2021. Advances
in Cognitive Translation Studies. Singapore: Springer Nature.
Oakes, Michael. 2019. “Statistics
for Corpus-Based and Corpus-Driven Approaches to Empirical Translation
Studies.” In Advances in Empirical Translation Studies: Developing
Translation Resources and Technologies, edited by Meng Ji and Michael Oakes, 28–52. Cambridge: Cambridge University Press.
Oakes, Michael, and Meng Ji. 2012. Quantitative
Methods in Corpus-Based Translation Studies: A Practical Guide to Descriptive Translation
Research. Amsterdam: John Benjamins.
Olohan, Maeve, and Mona Baker. 2009. “Coherence
and Clarity of Objectives in Doctoral Projects: A Research Design Workshop.” The Interpreter
and Translator
Trainer 3 (1): 143–164.
Page, Matthew J., Joanne E. McKenzie, Patrick M. Bossuyt, Isabelle Boutron, Tammy C. Hoffmann, Cynthia D. Mulrow, Larissa Shamseer et al. 2021. “The
PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews.” British Medical
Journal 372 (71): 1–9.
Pöchhacker, Franz. 2011. “Researching
Interpreting: Approaches to Inquiry.” In Advances in Interpreting
Research: Inquiry in Action, edited by Brenda Nicodemus and Laurie Swabey, 5–25. Amsterdam: John Benjamins.
Pöchhacker, Franz, and Minhua Liu. 2021. “Interpreting
Research in Print: A Quarter-Century
Update.” Interpreting 23 (1): 1–17.
Saldanha, Gabriela, and Sharon O’Brien. 2013. Research
Methodologies in Translation Studies. Manchester: St Jerome.
Schäffner, Christina, ed. 2004. Translation
Research and Interpreting Research: Traditions, Gaps and
Synergies. Clevedon: Multilingual Matters.
Shang, Xiaoqi, and Guixia Xie. 2020. “Aptitude
for Interpreting Revisited: Predictive Validity of Recall Across
Languages.” In Remote Interpreting, edited
by Mariachiara Russo, Emilia Iglesias Fernàndez, and Sabine Braun, special
issue of The Interpreter and Translator
Trainer 14 (3): 344–361.
Zanettin, Federico, Gabriela Saldanha, and Sue-Ann Harding. 2015. “Sketching
Landscapes in Translation Studies: A Bibliographic
Study.” In Bibliometric and Bibliographical Research in Translation
Studies, edited by Sara Rovira-Esteva, Pilar Orero, and Javier Franco Aixelá, special issue
of Perspectives 23 (2): 161–182.
Cited by (4)
Cited by four other publications
Han, Chao & Yueqing Wang
2025. Conducting replication in translation and interpreting studies. Target. International Journal of Translation Studies 37:3 ► pp. 444 ff.
Martín, Ricardo Muñoz & Ana María Rojo López
2025. Introduction. In Research Methods in Cognitive Translation and Interpreting Studies [Research Methods in Applied Linguistics, 10], ► pp. 1 ff.
Pan, Jeng-Shyang, Thi-Kien Dao, Trong-The Nguyen, Trinh-Dong Nguyen, Thi-Xuan-Huong Nguyen & Shaowei Weng
Liu, Xinyuan, Weiqing Xiao & Kanglong Liu
This list is based on CrossRef data as of 4 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.
