Cover not available

Article published In: Mapping Synergies in Cognitive Research on Multilectal Mediated Communication
Edited by Laura Babcock, Raphael Sannholm and Elisabet Tiselius
[Target 37:2] 2025
► pp. 244–270

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
EPUB logo with download linkDownload EPUB

Investigating cognitive and interpersonal factors in hybrid human-AI practices

An empirical exploration of interlingual respeaking

ORCiD logo with link | University of Surrey
ORCiD logo with link | University of Surrey
Open Access logo
Available under the Creative Commons Attribution (CC BY) 4.0 license.

For any use beyond this license, please contact the publisher at rights@benjamins.nl.

Open Access publication of this article was funded through a Transformative Agreement with University of Surrey.

Published online: 2 June 2025
DOI logo with link
https://doi.org/10.1075/target.00035.dav
Abstract
This article investigates interlingual respeaking (IRSP) as a hybrid practice involving direct interaction between a language professional and speech recognition software to produce live subtitles. This technique combines language transfer with the diamesic shift of subtitling, the immediacy factor of interpreting, and direct interaction with AI-driven technology. It is, therefore, a prime example of Multilectal Mediated Communication which requires language professionals to adapt the procedural skills acquired through training and professional experience in related fields. The article reports on an empirical study that explores cognitive abilities and interpersonal traits as underexamined but critical elements of competence in IRSP, guided by Hambrick, David Z., Alexander P. Burgoyne, Brooke N. Macnamara, and Fredrik Ullén. 2018. “Towards a Multifactorial Model of Expertise: Beyond Born Versus Made.” Annals of the New York Academy of Sciences 1423 (1): 284–295. Google Scholar logo with link to Google Scholar multifactorial model of expertise. A mixed-methods exploratory design was used to investigate factors influencing IRSP performance. Fifty-one language professionals participated in a twenty-five-hour upskilling course, completing pre- and post-experiment surveys as well as a battery of cognitive tasks and interpersonal skills scales. Multiple regression analyses were used to investigate predictors of IRSP accuracy and errors. Our study found that, among cognitive variables, complex working memory predicts accuracy. Additionally, different working memory resources were found to be involved in different error categories. In relation to interpersonal traits, integrated regulation (a measure of motivation) and conscientiousness were found to negatively predict accuracy. The study highlights the interplay between human cognitive and interpersonal variables in IRSP as a complex form of human-AI interaction, establishing a baseline for future research and advancing methodological approaches and training frameworks for language professionals working in AI-assisted environments.
Article outline
  • 1.Introduction
  • 2.Defining the domain: Interlingual respeaking as HAII
    • 2.1Interlingual respeaking competences
    • 2.2The SMART competence model
  • 3.Study design and methodology
    • 3.1Participants
  • 4.Key findings on cognitive abilities
  • 5.Key findings on interpersonal traits
  • 6.Discussion
  • Acknowledgments
  • Notes
  • References
References (49)
References
Ackerman, Phillip L. 2014. “Facts Are Stubborn Things.” Intelligence 45 (1): 104–106. Google Scholar logo with link to Google Scholar
Baddeley, Alan D., and Graham J. Hitch. 1974. “Working Memory.” In The Psychology of Learning and Motivation, edited by Gordon H. Bower, Volume 81, 47–89. Google Scholar logo with link to Google Scholar
Barad, Karen. 2007. Meeting the Universe Halfway: Quantum Physics and the Entanglement of Matter and Meaning. Durham: Duke University Press. Google Scholar logo with link to Google Scholar
Beilock, Sian. 2011. Choke — The Secret to Performing Under Pressure. London: Constable.Google Scholar logo with link to Google Scholar
Bernardini, Silvia, Pierrette Bouillon, Dragos Ciobanu, Josef van Genabith, Silvia Hansen-Schirra, Sharon O’Brien, Erich Steiner, and Elke Teich. 2019. “Language Service Provision in the 21st Century: Challenges, Opportunities and Educational Perspectives for Translation Studies.” In Bologna Process Beyond 2020: Fundamental Values of the EHEA, edited by Sijbolt Noorda, Peter Scott, and Martina Vukasovic, 297–303. Bologna: Bologna University Press.Google Scholar logo with link to Google Scholar
Bontempo, Karen, Jemina Napier, Laurence Hayes, and Vicki Brashear. 2014. “Does Personality Matter? An International Study of Sign Language Interpreter Disposition.” The International Journal of Translation and Interpreting Research 6 (1): 23–46. Google Scholar logo with link to Google Scholar
Coleman, Geoff, Adrian Furnham, and Luke Treglown. 2023. “Exploring the Dark Side of Conscientiousness. The Relationship Between Conscientiousness and Its Potential Derailers: Perfectionism and Narcissism.” Current Psychology 42 (31): 27744–27757. Google Scholar logo with link to Google Scholar
Conway, Andrew R. A., Michael J. Kane, Michael F. Bunting, D. Zach Hambrick, Oliver Wilhelm, and Randall W. Engle. 2005. “Working Memory Span Tasks: A Methodological Review and User’s Guide.” Psychonomic Bulletin & Review 12 (5): 769–786. Google Scholar logo with link to Google Scholar
Davitti, Elena. 2025. “Technology for Hybrid Modalities.” In The Routledge Handbook of Interpreting, Technology and AI, edited by Elena Davitti, Tomasz Korybski, and Sabine Braun, 181–208. London: Routledge. Google Scholar logo with link to Google Scholar
Davitti, Elena, Tomasz Korybski, Constantin Orăsan, and Sabine Braun. 2025. “Quality-Related Aspects.” In The Routledge Handbook of Interpreting, Technology and AI, edited by Elena Davitti, Tomasz Korybski, and Sabine Braun, 305–326. London: Routledge. Google Scholar logo with link to Google Scholar
Davitti, Elena, and Annalisa Sandrelli. 2020. “Embracing the Complexity: A Pilot Study on Interlingual Respeaking.” Journal of Audiovisual Translation 3 (2): 103–139. Google Scholar logo with link to Google Scholar
Davitti, Elena, Annalisa Sandrelli, Yuan Zou, Tomasz Korybski, and Anna-Stiina Wallinheimo. Under review. “Designing a Research-Informed Upskilling Course in Interlingual Respeaking for Language Professionals.”
Davitti, Elena, and Anna-Stiina Wallinheimo. 2024. Shaping Multilingual Access through Respeaking Technology, Project Data, 2021. UK Data Service. SN: 856687. Google Scholar logo with link to Google Scholar
Dawson, Hayley. 2019. “Feasibility, Quality and Assessment of Interlingual Live Subtitling.” Journal of Audiovisual Translation 2 (2): 36–56. Google Scholar logo with link to Google Scholar
. 2020. “A Research-Informed Training Course for Interlingual Respeaking.” Journal of Audiovisual Translation 3 (2): 204–225. Google Scholar logo with link to Google Scholar
Dawson, Hayley, and Pablo Romero-Fresco. 2021. “Towards Research-Informed Training in Interlingual Respeaking: An Empirical Approach.” The Interpreter and Translator Trainer 15 (1): 66–84. Google Scholar logo with link to Google Scholar
Deci, Edward L., and Richard M. Ryan. 1985. Intrinsic Motivation and Self-Determination in Human Behavior. New York: Plenum. Google Scholar logo with link to Google Scholar
Ellis, Lee, Anthony Hoskin, and Malini Ratnasingam. 2018. Handbook of Social Status Correlates. Amsterdam: Elsevier.Google Scholar logo with link to Google Scholar
Ericsson, K. Anders, Ralf T. Krampe, and Clemens Tesch-Römer. 1993. “The Role of Deliberate Practice in the Acquisition of Expert Performance.” Psychological Review 100 (3): 363–406. Google Scholar logo with link to Google Scholar
Fabri, Lukas, Björn Häckel, Anna Maria Oberländer, Marius Rieg, and Alexander Stohr. 2023. “Disentangling Human-AI Hybrids.” Business & Information Systems Engineering 651: 623–641. Google Scholar logo with link to Google Scholar
Gile, Daniel. 2015. “Effort Models.” In Routledge Encyclopedia of Interpreting Studies, edited by Franz Pöchhacker, 135–137. London: Routledge.Google Scholar logo with link to Google Scholar
. 2023. “The Effort Models and Gravitational Model: Clarifications and Update.” Google Scholar logo with link to Google Scholar
Hambrick, David Z., Brooke N. Macnamara, Guillermo Campitelli, Fredrik Ullén, Miriam A. Mosing. 2016. “Beyond Born Versus Made: A New Look at Expertise.” Psychology of Learning and Motivation 641: 1–55. Google Scholar logo with link to Google Scholar
Hambrick, David Z., Alexander P. Burgoyne, Brooke N. Macnamara, and Fredrik Ullén. 2018. “Towards a Multifactorial Model of Expertise: Beyond Born Versus Made.” Annals of the New York Academy of Sciences 1423 (1): 284–295. Google Scholar logo with link to Google Scholar
Hart, Sandra G., and Lowell E. Staveland. 1988. “Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research.” Advances in Psychology 521: 139–183. Google Scholar logo with link to Google Scholar
Henderson, John A. 1980. “Siblings Observed.” Babel 26 (4): 217–225. Google Scholar logo with link to Google Scholar
Hiltunen, Sinikka, Heli Mäntyranta, and Ilmari Määttänen. 2019. “Cooperativeness — A Necessary Trait for Interpreters? A Study on Temperament and Character Dimensions of Experts in Different Fields.” International Journal of Bilingualism 23 (6): 1385–1393. Google Scholar logo with link to Google Scholar
Howard, Joshua L., Julien S. Bureau, Frédéric Guay, Jane X. Y. Chong, and Richard M. Ryan. 2021. “Student Motivation and Associated Outcomes: A Meta-Analysis From Self-Determination Theory.” Perspectives on Psychological Science 16 (6): 1300–1323. Google Scholar logo with link to Google Scholar
Judge, Timothy A., and Joyce E. Bono. 2001. “Relationship of Core Self-evaluations Traits — Self-esteem, Generalized Self-efficacy, Locus of Control, and Emotional Stability — with Job Satisfaction and Job Performance: A Meta-analysis.” Journal of Applied Psychology 86 (1): 80–92. Google Scholar logo with link to Google Scholar
Korybski, Tomasz, and Elena Davitti. 2024. “Human Agency in Live Subtitling Through Respeaking: Towards a Taxonomy of Effective Editing.” Journal of Audiovisual Translation 7 (2): 1–22. Google Scholar logo with link to Google Scholar
Mattes, André, Markus Mück, and Jutta Stahl. 2022. “Perfectionism-related Variations in Error Processing in a Task with Increased Response Selection Complexity.” Personality Neuroscience 51: e12. Google Scholar logo with link to Google Scholar
Miyake, Akira, Naomi P. Friedman, Michael J. Emerson, Alexander H. Witzki, Amy Howerter, and Tor D. Wager. 2000. “The Unity and Diversity of Executive Functions and Their Contributions to Complex ‘Frontal Lobe’ Tasks: A Latent Variable Analysis.” Cognitive Psychology 41 (1): 49–100. Google Scholar logo with link to Google Scholar
Morales, Julia, Francisca Padilla, Carlos J. Gómez-Ariza, and M. Teresa Bajo. 2015. “Simultaneous Interpretation Selectively Influences Working Memory and Attentional Networks.” Acta Psychologica 1551: 82–91. Google Scholar logo with link to Google Scholar
O’Neill, Thomas, Nathan McNeese, Amy Heather Barron, and Beau G. Schelble. 2022. “Human–Autonomy Teaming: A Review and Analysis of the Empirical Literature.” Human Factors: The Journal of the Human Factors and Ergonomics Society 64 (5): 904–938. Google Scholar logo with link to Google Scholar
Pacailler, Matthew, Sarah Yahoodik, Tetsuya Sato, Jeremiah G. Ammons, and Jeremiah Still. 2022. “Human-Centered Artificial Intelligence: Beyond a Two-Dimensional Framework.” In Lecture Notes in Computer Science, edited by Jessie Y. C. Chen, Gino Fragomeni, Helmut Degen, and Stavruola Ntoa, 471–482. Springer.Google Scholar logo with link to Google Scholar
Pöchhacker, Franz, and Aline Remael. 2019. “New Efforts? A Competence-Oriented Task Analysis of Interlingual Live Subtitling.” Linguistica Antverpiensia 181: 130–143. Google Scholar logo with link to Google Scholar
Rai, Arun, Panos Constantinides, and Saonee Sarker. 2019. “Next Generation Digital Platforms: Toward Human-AI Hybrids.” MIS Quarterly 43 (1): iii–ix.Google Scholar logo with link to Google Scholar
Romero-Fresco, Pablo, and Franz Pöchhacker. 2017. “Quality Assessment in Interlingual Live Subtitling: The NTR Model.” Linguistica Antverpiensia 161: 149–167.Google Scholar logo with link to Google Scholar
Rosiers, Alexandra, and June Eyckmans. 2017. “Birds of a Feather? A Comparison of the Personality Profiles of Aspiring Interpreters and Other Language Experts.” Across Languages and Cultures 18 (1): 29–51. Google Scholar logo with link to Google Scholar
Rosiers, Alexandra, Koen Plevoets, and June Eyckmans. 2020. “Choosing to Become an Interpreter: A Matter of Personality and Memory Capacity.” Translation, Cognition & Behavior 3 (1): 25–50. Google Scholar logo with link to Google Scholar
Ryan, Richard M., and Edward L. Deci. 2000. “Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions.” Contemporary Educational Psychology 25 (1): 54–67. Google Scholar logo with link to Google Scholar
Thompson, Edmund R. 2008. “Development and Validation of an International English Big-Five Mini-Markers.” Personality and Individual Differences 45 (6): 542–548. Google Scholar logo with link to Google Scholar
Wallinheimo, Anna-Stiina, Simon L. Evans, and Elena Davitti. 2023. “Training in New Forms of Human-AI Interaction Improves Complex Working Memory and Switching Skills of Language Professionals.” Frontiers in Artificial Intelligence 61. Google Scholar logo with link to Google Scholar
Wati Halim, Fatima, Arifin Zainal, Rozainee Khairudin, Wan Shahrazad, Wan Sulaiman, Rohany Nasir, and Fatimah Omar. 2011. “Emotional Stability and Conscientiousness as Predictors Towards Job Performance.” Pertanika Journal of Social Science and Humanities 191: 139–145.Google Scholar logo with link to Google Scholar
Wilmot, Michael P., and Deniz S. Ones. 2019. “A Century of Research on Conscientiousness at Work.” Proceedings of the National Academy of Sciences 116 (46): 23004–23010. Google Scholar logo with link to Google Scholar
Wyer, Robert S. 2022. “The Activation and Use of Declarative and Procedural Knowledge.” In APA Handbook of Consumer Psychology, edited by Lynn R. Kahle, Tina M. Lowrey, and Joel Huber, 47–78. American Psychological Association. Google Scholar logo with link to Google Scholar
Xing, Xing, and Hua Zeng. 2022. “Exploring the Effects of Personality Hardiness on Interpreters’ Performance with Interpreting Anxiety as a Mediator: An Explanatory Sequential Mixed-Methods Study.” Across Languages and Cultures 23 (2): 187–205. Google Scholar logo with link to Google Scholar
Zaccaro, Stephen J. 2007. “Trait-Based Perspectives of Leadership.” American Psychologist 62 (1): 6–16. Google Scholar logo with link to Google Scholar
Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue