In:Innovation and Expansion in Translation Process Research
Edited by Isabel Lacruz and Riitta Jääskeläinen
[American Translators Association Scholarly Monograph Series XVIII] 2018
► pp. 217–240
Chapter 10An experimental investigation of stages of processing in post-editing
Published online: 1 February 2018
https://doi.org/10.1075/ata.18.10lac
https://doi.org/10.1075/ata.18.10lac
Abstract
This paper presents empirical evidence for the existence of distinctive stages in the post-editing process. We compare two behavioral tasks that are expected to differentiate between stages. We present reaction time data from a translation verification task experiment and key logging metrics from a post-editing experiment. These metrics provide information about the effort exerted during the processing of correct segments, segments with a mechanical error, and segments with a transfer error. Each metric reveals a different pattern of effort across the three error conditions. From this information, we infer the existence of distinct stages in the post-editing process.
Article outline
- Introduction
- Contrasting theoretical frameworks
- Stages of processing in post-editing
- Rationale
-
Experiment 1: Translation verification
- Method
- Participants
- Materials
- Procedure
- Apparatus
- Results and discussion
- Results
- Discussion
- Method
- Rationale for Experiment 2
-
Experiment 2: Post-editing
- Method
- Participants
- Materials
- Procedure
- Apparatus
- Results and discussion
- Results: First pause duration
- Discussion: First pause duration
- Results: Processing time per word
- Discussion: Processing time per word
- Results: Pause to word ratio
- Discussion: Pause to word ratio
- Method
- General discussion and conclusions
References
References (34)
Abdi, Hervé. 2010. “Holm’s sequential Bonferroni procedure.” In Encyclopedia of research design 1, ed. by Neil J. Salkind, 573–577. Thousand Oaks, CA: Sage.
Alves, Fabio. 2015. “Translation Process Research at the interface: Paradigmatic, theoretical, and methodological issues in dialogue with cognitive science, expertise studies, and psycholinguistics.” In Psycholinguistic and cognitive inquiries into translation and interpreting, ed. by Aline Ferreira and John W. Schwieter, 17–40. Amsterdam/Philadelphia: John Benjamins.
Angelone, Erik. 2010. “Uncertainty, uncertainty management, and metacognitive problem solving in the translation task.” In Translation and cognition, ed. by Gregory M. Shreve and Erik Angelone, 17–40. Amsterdam/Philadelphia: John Benjamins.
Balling, Laura Winther, and Michael Carl. 2014. “Production time across languages and tasks: A large-scale analysis using the CRITT Translation Process Database.” In The development of translation competence: Theories and methodologies from psycholinguistics and cognitive science, ed. by John W. Schwieter and Aline Ferreira, 239–265. Newcastle upon Tyne, England: Cambridge Scholars Publishing.
Caramazza, Alfonso, Stefano Anzellotti, Lukas Strand, and Angelika Lingnau. 2014. “Embodied cognition and mirror neurons: A critical assessment.” The Annual Review of Neuroscience 37: 1–15.
Carl, Michael and Barbara Dragsted. 2012. “Inside the monitor model: Processes of default and challenged translation production.” Translation: Computation, Corpora, Cognition 2: 127–145. [URL]
De Groot, Annette M. B. “The cognitive study of translation and interpretation.” In Cognitive processes in translation and interpreting, ed. by Joseph H. Danks, Gregory M. Shreve, Stephen B. Fountain, and Michael K. McBeath, 25–56. Thousand Oaks: Sage.
Denkowski, Michael and Alon Lavie. 2012. “TransCenter: Web-based translation research suite.” In AMTA 2012 workshop on post-editing technology and practice demo session (WPTP 12), San Diego, CA, ed. by Sharon O’Brien, Michel Simard, and Lucia Specia. Association for Machine Translation in the Americas. [URL].
Dragsted, Barbara, and Inge Gorm Hansen. 2008. “Comprehension and production in translation: a pilot study on segmentation and the coordination of reading and writing processes.” Copenhagen Studies in Language 36: 9–29.
. 2009. “Exploring translation and interpreting hybrids. The case of sight translation.” Meta: Translators’ Journal 54 (3): 588–604.
Elman, Jeffrey, Elizabeth A. Bates, Mark H. Johnson, Annette Karmiloff-Smith, Domenico Parisi, and Kim Plunkett. 1998. Rethinking innateness: A connectionist perspective on development. Cambridge MA: MIT Press
Englund Dimitrova, Birgitta. 2005. Expertise and explicitation in the translation process. Amsterdam/Philadelphia: John Benjamins.
Green, Spence, Jeffrey Heer, and Christopher D. Manning. 2013. “The efficacy of human post-editing for language translation.” In Proceedings of CHI Conference on Human Factors in Computing Systems (CHI ‘13), Paris, France, 439–448. New York, NY: Association for Computing Machinery.
Kiraly, Donald C. 1995. Pathways to translation: Pedagogy and process. Kent, OH: Kent State University Press.
Koby, Geoffrey, and Gertrud Champe. 2013. “Welcome to the real world: Professional-level translator certification.” Translation and Interpreting 5 (1): 156–173.
Koponen, Maarit, Wilker Aziz, Luciana Ramos, and Lucia Specia. 2012. “Post-editing time as a measure of cognitive effort.” Proceedings of the AMTA 2012 Workshop on Post-Editing Technology and Practice (WPTP 12), San Diego, CA, ed. by Sharon O’Brien, Michel Simard, and Lucia Specia, 11–20. Association for Machine Translation in the Americas.
Krings, Hans. 2001. Repairing texts: Empirical investigations of machine translation post-editing processes, trans. by Geoffrey Koby. Kent, OH: Kent State University Press.
Lacruz, Isabel. 2017. “Cognitive effort in translation, editing, and post-editing.” In The handbook of translation and cognition, ed. by John Schwieter and Aline Ferreira. Hoboken, NJ: Wiley-Blackwell.
Lacruz, Isabel, Michael Denkowski, and Alon Lavie. 2014. “Cognitive demand and cognitive effort in post-editing.” Proceedings of AMTA 2014. Third Workshop on Post-Editing Technology and Practice (WPTP 14), Vancouver, BC, ed. by Sharon O’Brien, Michel Simard, and Lucia Specia, 73–84. Association for Machine Translation in the Americas. [URL].
Lacruz, Isabel, Gregory M. Shreve, and Erik Angelone. 2012. “Average pause ratio as an indicator of cognitive effort in post-editing: A case study.” Proceedings of AMTA 2012. Workshop on Post-Editing Technology and Practice (WPTP 12), San Diego, CA, ed. by Sharon O’Brien, Michel Simard, and Lucia Specia, 21–30. Association for Machine Translation in the Americas.
Lacruz, Isabel, and Gregory M. Shreve. 2014. “Pauses and cognitive effort in post-editing.” In Post-editing of machine translation: Processes and applications, ed. by Sharon O’Brien, Laura Winther Balling, Michael Carl, and Lucia Specia, 246–272. Newcastle upon Tyne, England: Cambridge Scholars Publishing.
Macizo, Pedro, María Teresa Bajo, and María Cruz Martín. 2010. “Inhibitory processes in bilingual language comprehension: Evidence from Spanish-English interlexical homographs.” Journal of Memory and Language 63: 232–244.
PACTE. 2015. “Results of PACTE’s experimental research on the acquisition of translation competence: the acquisition of declarative and procedural knowledge in translation. The Dynamic translation index.” Translation Spaces 4 (1): 29–53.
Risku, Hanna. 2013. “Cognitive approaches to translation.” The encyclopedia of applied linguistics, ed. by Carol A. Chapelle, Oxford: Blackwell Publishing.
Rumelhart, David E. and James McClelland. 1986. Parallel distributed processing. Cambridge, MA: MIT Press.
Schaeffer, Moritz, and Michael Carl, M. 2013. “Shared representations and the translation process: A recursive model.” Translation and Interpreting Studies 8 (2): 169–190.
Schaeffer, Moritz, Michael Carl, Isabel Lacruz, and Akiko Aizawa. 2016. “Measuring cognitive translation effort with activity units.” Baltic Journal of Modern Computing 4 (2): 331–345.
Schilperoord, Joost. 1996. It’s about time: Temporal aspects of cognitive processes in text production. Amsterdam: Rodopi.
Shreve, Gregory M., Isabel Lacruz, and Erik Angelone. 2011. “Sight translation and speech disfluency: Performance analysis as a window to cognitive translation processes.” In Methods and strategies of process research, ed. by Cecilia Alvstad, Adelina Hild, and Elizabeth Tiselius, 93–120. Amsterdam/ Philadelphia: John Benjamins.
Sunderman, Gretchen and Judith F. Kroll. 2006. “First language activation during second language lexical processing: An investigation of lexical form, meaning, and grammatical class.” Studies in Second Language Acquisition 28 (3): 387–422.
Timarová, Sarka, Barbara Dragsted, and Inge Gorm Hansen. 2011. “Time lag in translation and interpreting.” In Methods and strategies of process research, ed. by Cecilia Alvstad, Adelina Hild, A., and Elisabet Tiselius, 121–146. Amsterdam/ Philadelphia: John Benjamins.