Article published In: Fair MT: Towards ethical, sustainable Machine Translation
Edited by Joss Moorkens, Dorothy Kenny and Félix do Carmo
[Translation Spaces 9:1] 2020
► pp. 58–77
Risks in neural machine translation
Published online: 17 August 2020
https://doi.org/10.1075/ts.00021.can
https://doi.org/10.1075/ts.00021.can
Abstract
The new paradigm of neural machine translation is leading to profound changes in the translation industry. Surprisingly good results have led to high expectations; however, there are substantial risks that have not yet been sufficiently taken into account. Risks exist on three levels: first, what kind of damage can clients and end users incur in safety-critical domains if the NMT result contains errors; second, who is liable for damage caused by the use of NMT; third, what cyber risks can the use of NMT entail, especially when free online engines are used. When establishing sustainable measures to reduce such risks, we also need to consider general principles of human behaviour if we want to make sure that all agents comply with provisions and requirements.
Article outline
- 1.Introduction
- 2.Dimensions of NMT risks
- 2.1Translation errors
- 2.2Accountability – Liability – Responsibility
- 2.3NMT cyber risks
- 3.Sustainable workflows for NMT use
- 3.1Non-technical measures (legislative and normative requirements)
- 3.2Technical measures
- 4.Conclusions
- Notes
References
References (85)
Akerlof, George, and Rachel E. Kranton. 2010. Identity Economics: How Identities Shape Our Work, Wages, and Well-Being. New Jersey: Princeton University Press.
Algorithmenethik. 2018. “Roboter sind auch nur Menschen!? [Robots are only Humans!?]“ Algorithmenethik Blog. Accessed 19 February 2020, [URL]
Allianz. 2019. “Allianz Risk Barometer. Top Business Risks for 2019.” Allianz Reports. Accessed 19 February 2020, [URL]
Arthur, Philip, Graham Neubig, and Satoshi Nakamura. 2016. “Incorporating Discrete Translation Lexicons into Neural Machine Translation.” Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 1557–1567.
BaFin (Bundesanstalt für Finanzdienstleistungsaufsicht [German Federal Financial Supervisory Authority]). 2018. “Big data meets artificial intelligence. Challenges and implications for the supervision and regulation of financial services.” Bafin – Publications & Data. Accessed 19 February 2020, [URL]
Balebako, Rebecca, Pedro Leon, Hazim Almuhimedi, Patrick Kelley, Jonathan Mugan, Alessandro Acquisti, Lorrie Cranor, and Norman Sadeh. 2011. “Nudging Users Towards Privacy on Mobile Devices.” Proceedings of the 2nd International Workshop on Persuasion, Influence, Nudge & Coercion Through Mobile Devices. Vancouver, Canada, May 8, 2011, 23–26. Accessed 19 February 2020, [URL]
Bowker, Lynne, and Jairo Buitrago Ciro. 2019. Machine Translation and Global Research: Towards Improved Machine Translation Literacy in the Scholarly Community. Bingley, UK: Emerald Publishing.
Canfora, Carmen, and Angelika Ottmann. 2018. “Of Ostriches, Pyramids, and Swiss Cheese: Risks in Safety-Critical Translations.” Translation Spaces 7 (2): 167–201.
. 2019. “Who’s Afraid of Translation Risks?” In Challenging Boundaries: New Approaches to Specialized Communication, edited by Heike Elisabeth Jüngst, Lisa Link, Klaus Schubert, and Christiane Zehrer. 73–92. Berlin: Frank & Timme.
Castilho, Sheila, Joss Moorkens, Federico Gaspari, Iacer Calixto, John Tinsley, and Andy Way. 2017. “Is Neural Machine Translation the New State of the Art?” The Prague Bulletin of Mathematical Linguistics 1081: 109–120. Accessed 19 February 2020, [URL]
Castilho, Sheila, Joss Moorkens, Federico Gaspari, Rico Sennrich, Vilelmini Sosoni, Panayota Georgakopoulou, Pintu Lohar, Andy Way, Antonio Valerio Miceli Barone, and Maria Gialama. 2017. “A Comparative Quality Evaluation of PBSMT and NMT using Professional Translators.” Proceedings of MT Summit XVI, vol. 1: Research Track. Nagoya, September 8–11, 2017, 116–131. Accessed 19 February 2020, [URL]
Cebula, James J., and Lisa R. Young. 2010. “A Taxonomy of Operational Cyber Security Risks.” Software Engineering Institute. Technical Note CMU/SEI-2010-TN-028.
Daems, Joke, and Lieve Macken. 2019. “Interactive adaptive SMT versus interactive NMT: a user experience evaluation.” Machine Translation 331: 117–134.
Daems, Joke, Sonia Vandepitte, Robert J. Hartsuiker, and Lieve Macken. 2017. “Identifying the Machine Translation Errors with the Greatest Impact on Post-editing Effort.” Frontiers in Psychology 81: 282.
Dannewitz Linder, Mats. 2018. “How (Un)Safe is Machine Translation?”. SDL Trados Studio. The Manual Blog. Accessed 19 February 2020, [URL]
DeepL Pro. n.d. “Allgemeine Geschäftsbedingungen [Terms of Service]”. Accessed 19 February 2020, [URL]
DeepL Translator. n.d. “Allgemeine Geschäftsbedingungen [Terms of Service]”. Accessed 19 February 2020, [URL]
DePalma, Don. 2014. “Free Machine Translation Can Leak Data.” tcworld e-magazine July 2014. Accessed 19 February 2020, [URL]
Downie, Jonathan, and Angela Dickson. 2019. “Unsound Evaluations of Medical Machine Translation Risk Patient Health and Confidentiality.” JAMA Internal Medicine 179 (7): 1001. Accessed 19 February 2020, [URL]
Elkington, John. 1998. Cannibals with Forks: The Triple Bottom Line of 21st Century Businesses. Gabriola Island, B.C., Canada: New Society Publishers.
European Commission. 2012. “Studies on Translation and Multilingualism. Language and Translation in International Law and EU Law.” Directorate-General for Translations (European Commission).
. 2018. “Commission Staff Working Document: Liability for Emerging Digital Technologies.” Accessed 19 February 2020, [URL]
. 2019. “Ethics Guidelines for Trustworthy AI.” High-Level Expert Group on Artificial Intelligence. Accessed 19 February 2020, [URL]
European Parliament. 2001. Directive 2001/95/EC of the European Parliament and the Council of 3 December 2001 on General Product Safety.
. 2006. Directive 2006/42/EC of the European Parliament and the Council of 17 May 2006 on Machinery, and amending Directive 95/16/EC (recast).
. 2008. Decision 768/2008/EC of the European Parliament and of the Council of 9 July 2008 on a Common Framework for the Marketing of Products (New Legislative Framework). Accessed 19 February 2020, [URL]
. 2017. “Report with Recommendations to the Commission on Civil Law Rules on Robotics (2015/2103 [INL]).” Committee on Legal Affairs. Accessed 19 February 2020, [URL]
FDA (Food and Drug Administration). 2015. “Warning Letter – Smith & Nephew Inc. MARCS-CMS 457814 – April 30, 2015.” FDA Warning Letters. Accessed 19 February 2020, [URL]
Galai, Dan, and Orly Sade. 2005. “The Ostrich effect and the Relationship between the Liquidity and the Yields of Financial Assets.” The Journal of Business 79 (5): 2741–2759.
Gartner. 2018. “5 Trends Emerge in the Gartner Hype Cycle for Emerging Technologies, 2018”. Gartner Blog. Accessed 19 February 2020, [URL]
Google. 2017. “Google Privacy & Terms – Terms of Service”. Accessed 19 February 2020, [URL]
Grizzo, Sara. 2018. “DeepL Pro – Pro Produktivität und Vertraulichkeit [DeepL Pro – Pro Productivity and Confidentiality].” MDÜ 2/2018: 33–35.
Hillson, David. 2006. “Integrated Risk Management as a Framework for Organisational Success.” Paper presented at PMI® Global Congress 2006, Seattle, WA. Accessed 19 February 2020, [URL]
Iansiti, Marco, and Karim R. Lakhani. 2017. “The Truth about Blockchain.” Harvard Business Review January February 2017: 118–127. Accessed 19 February 2020, [URL]
IEC (International Electrotechnical Committee). 2019. IEC 82079-1:2019 Preparation of Information for Use (Instructions for Use) of Products – Part 1: Principles and General Requirements. Paris: ISO.
IRM (Institute of Risk Management). 2018. “A Risk Practitioners Guide to ISO 31000:2018.” IRM Resource Centre. Accessed 19 February 2020, [URL]
ISO (International Standardization Organization). 2010. ISO 12100:2010 Safety of Machinery – General Principles for Design – Risk Assessment and Risk Reduction. Paris: ISO.
. 2013. ISO/IEC 27001:2013 Information technology – Security techniques – Information security management systems – Requirements. Paris: ISO.
. 2016. ISO 13485:2016 Medical Devices – Quality Management Systems – Requirements for Regulatory Purposes. Paris: ISO.
. 2017. ISO 18587:2017 Translation Services – Post-Editing of Machine Translation Output – Requirements. Paris: ISO.
. 2019. ISO 20607 Safety of Machinery – Instruction Handbook – General Drafting Principles. Paris: ISO.
Joyce, William. 2006. “Accounting, Purchasing and Supply Chain Management”. Supply Chain Management: An International Journal 11 (3): 202–207.
Kahneman, Daniel, and Amos Tversky. 1982. “The Psychology of Preferences.” Scientific American 246 (1): 160–173. Accessed 19 February 2020, [URL]
Karlsson, Niklas, George Loewenstein, and Duane Seppi. 2009. “The Ostrich Effect: Selective Attention to Information.” Journal of Risk and Uncertainty 38 (2): 95–115.
Khoong, Elaine, Eric Steinbrook, Cortlyn Brown, and Alicia Fernandez. 2019. “Assessing the Use of Google Translate for Spanish and Chinese Translations of Emergency Department Discharge Instructions.” JAMA Internal Medicine 179 (4): 580–82. Accessed 19 February 2020, [URL]
Koehn, Phillip, and Rebecca Knowles. 2017. “Six Challenges for Neural Machine Translation.” Proceedings of the 1st Workshop on Neural Machine Translation, Vancouver, BC, Canada, 28–39. Accessed 19 February 2020, [URL].
Krüger, Ralph. 2019. “Augmented Translation – eine Bestandsaufnahme des rechnergestützten Fachübersetzungsprozesses [Augmented Translation – A Survey of Computer-aided Technical Translation Processes].” trans-kom 12 (1): 142–81. Accessed 19 February 2020, [URL]
Kwon, Ik-Whan G., and Taewon Suh. 2004. “Factors Affecting the Level of Trust and Commitment in Supply Chain Relationships.” Journal of Supply Chain Management 40 (1): 4–14.
Leite, Fernando Ochoa, Catarina Cochat, Henrique Salgado, Mariana Pinto da Costa, Marta Queirós, Olga Campos, and Paulo Carvalho. 2016. “Using Google Translate in the Hospital: A Case Report.” Technology and Health Care 24 (6): 965–968.
Lenssen, Joris-Johann, Nikolay A. Dentchev, and Ludwig Roger. 2014. “Sustainability, Risk Management and Governance: Towards an Integrative Approach.” Corporate Governance International Journal of Business in Society 14 (5): 670–84.
Moberly, Tom. 2018. “Doctors Choose Google Translate to Communicate with Patients Because of Easy Access.” British Medical Journal 2018 (362): k3974.
Moorkens, Joss. 2017. “Under Pressure: Translation in Times of Austerity.” Perspectives Studies in Translation Theory and Practice 25 (3): 464–77.
. 2019. “Human Factors in Neural Machine Translation.” Paper presented at Université Paris Diderot, 15 March 2019. Accessed 19 February 2020, [URL]
Moorkens, Joss, and Dave Lewis. 2019. “Research Questions and a Proposal for the Future Governance of Translation Data.” Jostrans – The Journal of Specialised Translation 321: 2–25. Accessed 19 February 2020, [URL]
. 2020. “Chapter 28. Copyright and the Reuse of Translation Data.” In The Routledge Handbook of Translation and Technology, edited by Minako O’Hagan. Abingdon: Routledge, 469–481.
Morgan, Robert M., and Shelby D. Hunt. 1994. “The Commitment-Trust Theory of Relationship Marketing.” Journal of Marketing 58 (3): 20–38.
Nitzke, Jean, Silvia Hansen-Schirra, and Carmen Canfora. 2019. “Risk management and post-editing competence.” Jostrans – The Journal of Specialised Translation 311: 239–59. Accessed 19 February 2020, [URL]
Nunes Vieira, Lucas, and Elisa Alonso. 2019. “Translating Perceptions and Managing Expectations: An Analysis of Management and Production perspectives on Machine Translation.” Perspectives Studies in Translation Theory and Practice.
Nurminen, Mary, and Maarit Koponen. 2018. “Governments, NGOs, MT and Accessibility.” Presentation held at Kites/ELRC Workshop, 24 October 2018, Helsinki, Finland. Accessed 19 February 2020, [URL]
Pairaphrase. 2019. “End User License Agreement.” Accessed 19 February 2020, [URL]
Proz.com. 2017. “Fate of crossTank and crossTerm Entries in Remote Client Mode.” Proz.com Translation Industry Discussion Forums. Accessed 19 February 2020, [URL]
. 2018. “Is Translation a Field I Can Work in Despite the Rise of MT?” Proz.com Translation Industry Discussion Forums. Accessed 19 February 2020, [URL]
. 2019. “Anyone Want to Go on STRIKE?” Proz.com Translation Industry Discussion Forums. Accessed 19 February 2020, [URL]
Sakamoto, Akiko. 2019. “Unintended Consequences of Translation Technologies: From Project Managers’ Perspectives.” Perspectives Studies in Translation Theory and Practice 271: 58–73.
Sakamoto, Akiko, and Masaru Yamada. 2019. “Promoting Ethical and Sustainable Use of MT in the Translation Industry: A Case in Japan.” Paper presented at the Fair MT Workshop, MT Summit 2019, Dublin City University. Accessed 19 February 2020, [URL]
Sakamoto, Akiko, Begoña Rodríguez de Céspedes, Sarah Berthaud, and Jonathan Evans. 2017. “When Translation meets Technology. Language Service Providers (LSPs) in the Digital Age.” Focus Group Report (October 2017). Accessed 19 February 2020, [URL]
Skoglösa, Örjan. 2019. “Vad tycker vi översättare om maskinöversättning? [What Do We Translators Think about Machine Translation?]” Facköversättaren 11: 16–19. Accessed 19 February 2020, [URL]
Slator. 2017. “Translate.com Exposes Highly Sensitive Information in Massive Privacy Breach.” Slator.com Blog. Accessed 19 February 2020, [URL]
Sutcliffe, Laura, Anja Maier, James Moultrie, and John Clarkson. 2009. “Development of a Framework for Assessing Sustainability in New Product Development.” Proceedings of the International Conference on Engineering Design 58 (7): 24–27 August 2009, Palo Alto, CA, USA. Accessed 19 February 2020, [URL]
Systran. 2016. “Is Your Team Violating Data Compliance Laws with Online Translation Tools?” Systran Blog. Accessed 19 February 2020, [URL]
Toft, Yvonne, Prue Howard, and David Jorgensen. 2003. “Changing Paradigms for Professional Engineering Practice towards Safe Design – An Australian Perspective.” Safety Science 41 (2–3): 263–276.
Tversky, Amos, and Daniel Kahneman. 1973. “Availability: A Heuristic for Judging Frequency and Probability.” Cognitive Psychology 5 (2): 207–232. ”.
Vaezian, Helia, and Mahmoud Akbari. 2018. “Common Risks in the Translation Industry. A Sequential Exploratory Study.” The Journal of Internationalization and Localization 5 (2): 95–113.
Van Brussel, Laura, Arda Tezcan, and Lieve Macken. 2018. “A Fine-Grained Error Analysis of NMT, PBMT and RBMT Output for English-to-Dutch.” Proceedings of the Eleventh International Conference on Language Resources and Evaluation, May 2018, Miyazaki, Japan, 3799–3804. Accessed 19 February 2020, [URL]
Vashee, Kirti. 2017. “Data Security Risks with Generic and Free Machine Translation.” Empty Pages Blog. Accessed 19 February 2020, [URL]
Way, Andy. 2019. “Chapter 14. Machine Translation: Where Are We at Today?” In The Bloomsbury Companion to Language Industry Studies, edited by Eric Angelone, Maureen Ehrensberger-Dow, and Gary Massey. London: Bloomsbury.
WBCSD (World Business Council for Sustainable Development). 2016. “Sustainability and Enterprise Risk Management: The First Step Towards Integration.” WBCSD Reports. Accessed 19 February 2020, [URL]
Weinmann, Markus, Christoph Schneider, and Jan vom Brocke. 2016. “Digital Nudging” Business & Information Systems Engineering 58 (6): 433–436.
World Economic Forum. 2017. “Global Risks of Highest Concern for Doing Business.” World Economic Forum Reports. Accessed 19 February 2020, [URL]
Cited by (33)
Cited by 33 other publications
Bernardini, Silvia & Federico Gaspari
2025. The evolution of Translation (Studies) in the Technocene. Translation and Translanguaging in Multilingual Contexts 11:3 ► pp. 237 ff.
Greenall, Annjo Klungervik & Inger Hesjevoll Schmidt-Melbye
2025. Perceptions and management of risk
in the translation of a Norwegian-language health app into English. Babel. Revue internationale de la traduction / International Journal of Translation / Revista Internacional de Traducción 71:3 ► pp. 330 ff.
Holgado-Sáez, Christina & Silvia Martínez Martínez
Moorkens, Joss
Nurminen, Mary
Rivas Ginel, María Isabel & Joss Moorkens
Yang, Tian & Susana Valdez
Brewster, Ryan C.L., Priscilla Gonzalez, Rohan Khazanchi, Alex Butler, Raquel Selcer, Derrick Chu, Barbara Pontes Aires, Marcella Luercio & Jonathan D. Hron
Ciobanu, Dragoș , Miguel Rios, Alina Secară, Justus Brockmann, Raluca-Maria Chereji & Claudia Wiesinger
Mohamed, Yasir Abdelgadir, Akbar Khanan, Mohamed Bashir, Abdul Hakim H. M. Mohamed, Mousab A. E. Adiel & Muawia A. Elsadig
Quinci, Carla
Rico Pérez, Celia
Özmat, Demet & Buket Akkoyunlu
González Vallejo, Rubén
Guerberof-Arenas, Ana & Joss Moorkens
Ma, Yuwei & Yu Qian
Mondal, Subrota Kumar, Haoxi Zhang, H. M. Dipu Kabir, Kan Ni & Hong-Ning Dai
Nunes Vieira, Lucas, Carol O’Sullivan, Xiaochun Zhang & Minako O’Hagan
Vieira, Lucas Nunes, Carol O’Sullivan, Xiaochun Zhang & Minako O’Hagan
Ramírez-Polo, Laura & Chelo Vargas-Sierra
Rico, Celia & María del Mar Sánchez Ramos
Riemland, Matt
2023. Theorizing sustainable, low-resource MT in development settings. Translation Spaces 12:2 ► pp. 231 ff.
Singh, Digvijay, Garvit Vijay, Akanksha Gupta, Manas Yadav, Atul Mishra & Kiran Khatter
Tahir, Madiha, Zahid Halim, Muhmmad Waqas & Shanshan Tu
Horváth, Ildikó
Krüger, Ralph
Krüger, Ralph
Rico, Celia
2022. Mind the gap. Babel. Revue internationale de la traduction / International Journal of Translation 68:5 ► pp. 697 ff.
Fırat, Gökhan
2021. Uberization of translation. The Journal of Internationalization and Localization 8:1 ► pp. 48 ff.
Kasperė, Ramunė, Jolita Horbačauskienė, Jurgita Motiejūnienė, Vilmantė Liubinienė, Irena Patašienė & Martynas Patašius
Matsushita, Kayo
2021. Risk in translation. In Handbook of Translation Studies [Handbook of Translation Studies, 5], ► pp. 199 ff.
This list is based on CrossRef data as of 6 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.
