Cover not available

In:Risk Discourse and Responsibility
Edited by Annelie Ädel and Jan-Ola Östman
[Pragmatics & Beyond New Series 336] 2023
► pp. 190–212

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload Book PDF
EPUB logo with download linkDownload Book EPUB
authorization required

Chapter 8
The effects of using machine translation on perceptions of source credibility

ORCiD logo with link | Åbo Akademi University, Finland
Published online: 24 July 2023
DOI logo with link
https://doi.org/10.1075/pbns.336.08leh
Abstract
Machine translation has great potential for increasing the reach and spread of risk communication in multi-lingual settings. However, the social psychological effects of communicating via machine translation applications remain unknown. This study takes a first step to address this research gap. An online experiment with between-participants design was conducted to investigate the effects of using machine translation on participants’ perceptions of source credibility. Participants were asked to navigate a map of a foreign city and follow the route directions that were given to them by a person in a video either in their first language or using a machine translation application. Regression models were used to analyze task performance, perceptions of task difficulty, and perceptions of source credibility. Contrary to expectations, the results show no significant effect of using machine translation on the perceptions of source credibility. Implications for risk communication and future research are discussed.
Article outline
  • 1.Introduction
  • 2.Related work on source credibility, trust, and technology-mediated communication
  • 3.Methods
    • 3.1Participant sample
    • 3.2Independent variables and experimental design
    • 3.3Dependent variables and methods of analysis
  • 4.Results
    • 4.1Task performance
    • 4.2Perceived difficulty of the task
    • 4.3Source credibility
  • 5.Discussion and implications for risk communication
  • Notes
  • References
References (55)
References
Audacity Team. 2021. Audacity: Free Audio Editor and Recorder [Computer application]. Version 3.0.0. [URL]
Balog-Way, Dominic, Darrick Evensen, Ragnar Löfstedt, and Frederic Bouder. 2021. “Effects of Public Trust on Behavioural Intentions in the Pharmaceutical Sector: Data from Six European Countries.” Journal of Risk Research 24 (6): 645–72. Google Scholar logo with link to Google Scholar
Basch, Johannes M., Klaus G. Melchers, Julia Kegelmann, and Leonie Lieb. 2020. “Smile for the Camera! The Role of Social Presence and Impression Management in Perceptions of Technology-Mediated Interviews.” Journal of Managerial Psychology 35 (4): 285–299. Google Scholar logo with link to Google Scholar
Berlo, David K., James B. Lemert, and Robert J. Mertz. 1969. “Dimensions for Evaluating the Acceptability of Message Sources.” Public Opinion Quarterly 33 (4): 563–76. Google Scholar logo with link to Google Scholar
Blair, Robert A., Benjamin S. Morse, and Lily L. Tsai. 2017. “Public Health and Public Trust: Survey Evidence from the Ebola Virus Disease Epidemic in Liberia.” Social Science & Medicine 172: 89–97. Google Scholar logo with link to Google Scholar
Bowers, John Waite, and William A. Phillips. 1967. “A Note on the Generality of Source-Credibility Scales.” Speech Monographs 34 (2): 185–186. Google Scholar logo with link to Google Scholar
Danielson, David R., and Soo Young Rieh. 2007. “Credibility: A Multidisciplinary Framework.” Annual Review of Information Science and Technology 41 (1): 307–364. Google Scholar logo with link to Google Scholar
Dutta-Bergman, Mohan J. 2004. “The Impact of Completeness and Web Use Motivation on the Credibility of E-Health Information.” Journal of Communication 54 (2): 253–69. Google Scholar logo with link to Google Scholar
Earle, Timothy C. 2010. “Trust in Risk Management: A Model-based Review of Empirical Research.” Risk Analysis: An International Journal 30 (4): 541–74. Google Scholar logo with link to Google Scholar
Fantinuoli, Claudio. 2018. “Interpreting and Technology: The Upcoming Technological Turn.” In Interpreting and Technology, ed. by Claudio Fantinuoli, 1–12. Berlin: Language Science Press.Google Scholar logo with link to Google Scholar
Fantinuoli, Claudio, and Bianca Prandi. 2021. “Towards the Evaluation of Automatic Simultaneous Speech Translation from a Communicative Perspective.” arXiv:2103.08364. Google Scholar logo with link to Google Scholar
Flanagin, Andrew J., Kristin Page Hocevar, and Siriphan Nancy Samahito. 2014. “Connecting with the User-Generated Web: How Group Identification Impacts Online Information Sharing and Evaluation.” Information, Communication & Society 17 (6): 683–94. Google Scholar logo with link to Google Scholar
Greenaway, Katharine H., S. Alexander Haslam, Tegan Cruwys, Nyla R. Branscombe, Renate Ysseldyk, and Courtney Heldreth. 2015. “From “We” to “Me”: Group Identification Enhances Perceived Personal Control with Consequences for Health and Well-Being.” Journal of Personality and Social Psychology 109 (1): 53. Google Scholar logo with link to Google Scholar
Grosjean, François. 1982. Life with Two Languages: An Introduction to Bilingualism. Cambridge, MA: Harvard University Press.Google Scholar logo with link to Google Scholar
Gunawardena, Charlotte N., and Frank J. Zittle. 1997. “Social Presence as a Predictor of Satisfaction within a Computer-Mediated Conferencing Environment.” American Journal of Distance Education 11 (3): 8–26. Google Scholar logo with link to Google Scholar
Hassan, Hany, Anthony Aue, Chang Chen, Vishal Chowdhary, Jonathan Clark, Christian Federmann, Xuedong Huang, et al. 2018. “Achieving Human Parity on Automatic Chinese to English News Translation.” arXiv:1803.05567, [URL]
Henderson, Jane Kassis, and Leena Louhiala-Salminen. 2011. “Does Language Affect Trust in Global Professional Contexts? Perceptions of International Business Professionals.” Journal of Rhetoric, Professional Communication, and Globalization 2 (1): 2.Google Scholar logo with link to Google Scholar
Hocevar, Kristin Page, Miriam Metzger, and Andrew J. Flanagin. 2017. “Source Credibility, Expertise, and Trust in Health and Risk Messaging.” In Oxford Research Encyclopedia of Communication. Google Scholar logo with link to Google Scholar
Hovland, Carl I., and Walter Weiss. 1951. “The Influence of Source Credibility on Communication Effectiveness.” Public Opinion Quarterly 15 (4): 635–50. Google Scholar logo with link to Google Scholar
Hovland, Carl Iver, Irving Lester Janis, and Harold H. Kelley. 1953. Communication and Persuasion. New Haven, CT: Yale University Press.Google Scholar logo with link to Google Scholar
Kano, Takatomo, Shinnosuke Takamichi, Sakriani Sakti, Graham Neubig, Tomoki Toda, and Satoshi Nakamura. 2018. “An End-to-End Model for Cross-Lingual Transformation of Paralinguistic Information.” Machine Translation 32 (4): 353–68. Google Scholar logo with link to Google Scholar
Koehn, Philipp, and Rebecca Knowles. 2017. “Six Challenges for Neural Machine Translation.” arXiv:1706.03872, Google Scholar logo with link to Google Scholar
Langman, Juliet, and Xingsong Shi. 2020. “Gender, Language, Identity, and Intercultural Communication.” In The Routledge Handbook of Language and Intercultural Communication, ed. by Jane Jackson, 219–33. London and New York: Routledge. Google Scholar logo with link to Google Scholar
Larkey, Linda Kathryn. 1996. “The Development and Validation of the Workforce Diversity Questionnaire: An Instrument to Assess Interactions in Diverse Workgroups.” Management Communication Quarterly 9 (3): 296–337. Google Scholar logo with link to Google Scholar
Leiner, Dominik J. 2019. SoSci Survey (Version 3.1. 06). [Computer Software]. Available at [URL]
Lewis, William D. 2010. “Haitian Creole: How to Build and Ship an MT Engine from Scratch in 4 Days, 17 Hours, & 30 Minutes.” In Proceedings of the 14th Annual Conference of the European Association for Machine Translation.Google Scholar logo with link to Google Scholar
Lewis, William D., Robert Munro, and Stephan Vogel. 2011. “Crisis MT: Developing a Cookbook for MT in Crisis Situations.” In Proceedings of the Sixth Workshop on Statistical Machine Translation, 501–511.Google Scholar logo with link to Google Scholar
Liviatan, Ido, Yaacov Trope, and Nira Liberman. 2008. “Interpersonal Similarity as a Social Distance Dimension: Implications for Perception of Others’ Actions.” Journal of Experimental Social Psychology 44 (5): 1256–69. Google Scholar logo with link to Google Scholar
Mackie, Diane M. 1986. “Social Identification Effects in Group Polarization.” Journal of Personality and Social Psychology 50 (4): 720. Google Scholar logo with link to Google Scholar
Mackie, Diane M., M. Cecilia Gastardo-Conaco, and John J. Skelly. 1992. “Knowledge of the Advocated Position and the Processing of In-Group and Out-Group Persuasive Messages.” Personality and Social Psychology Bulletin 18 (2): 145–51. Google Scholar logo with link to Google Scholar
McComas, Katherine A., John C. Besley, and Joseph Steinhardt. 2014. “Factors Influencing US Consumer Support for Genetic Modification to Prevent Crop Disease.” Appetite 78: 8–14. Google Scholar logo with link to Google Scholar
McCroskey, James C. 1966. “Scales for the Measurement of Ethos.” Speech Monographs 33 (1): 65–72. Google Scholar logo with link to Google Scholar
McCroskey, James C., and Jason J. Teven. 1999. “Goodwill: A Reexamination of the Construct and Its Measurement.” Communications Monographs 66 (1): 90–103. Google Scholar logo with link to Google Scholar
McCroskey, James C., and Thomas J. Young. 1981. “Ethos and Credibility: The Construct and Its Measurement after Three Decades.” Communication Studies 32 (1): 24–34.Google Scholar logo with link to Google Scholar
Metzger, Miriam J., Andrew J. Flanagin, Keren Eyal, Daisy R. Lemus, and Robert M. McCann. 2003. “Credibility for the 21st Century: Integrating Perspectives on Source, Message, and Media Credibility in the Contemporary Media Environment.” Annals of the International Communication Association 27 (1): 293–335. Google Scholar logo with link to Google Scholar
Nardi, Bonnie A., and Steve Whittaker. 2002. “The Place of Face-to-Face Communication in Distributed Work.” In Distributed Work, ed. by Pamela J. Hinds, and Sara Kiesler, 83–112. Cambridge, MA: The MIT Press.Google Scholar logo with link to Google Scholar
Norton, Bonny. 2010. “Language and Identity.” Sociolinguistics and Language Education 23 (3): 349–69. Google Scholar logo with link to Google Scholar
Pandey, Rohan, Vaibhav Gautam, Ridam Pal, Harsh Bandhey, Lovedeep Singh Dhingra, Vihaan Misra, Himanshu Sharma, Chirag Jain, Kanav Bhagat, and Lajjaben Patel. 2022. “A Machine Learning Application for Raising Wash Awareness in the Times of Covid-19 Pandemic.” Scientific Reports 12 (1): 1–10. Google Scholar logo with link to Google Scholar
Platow, Michael J., Duncan Mills, and Dianne Morrison. 2000. “The Effects of Social Context, Source Fairness, and Perceived Self-source Similarity on Social Influence: A Self-Categorisation Analysis.” European Journal of Social Psychology 30 (1): 69–81. Google Scholar logo with link to Google Scholar
Popel, Martin, Marketa Tomkova, Jakub Tomek, Łukasz Kaiser, Jakob Uszkoreit, Ondřej Bojar, and Zdeněk Žabokrtský. 2020. “Transforming Machine Translation: A Deep Learning System Reaches News Translation Quality Comparable to Human Professionals.” Nature Communications 11 (1): 1–15. Google Scholar logo with link to Google Scholar
Pornpitakpan, Chanthika. 2004. “The Persuasiveness of Source Credibility: A Critical Review of Five Decades’ Evidence.” Journal of Applied Social Psychology 34 (2): 243–81. Google Scholar logo with link to Google Scholar
R Core Team. 2020. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. [URL]
Renn, Ortwin, and Debra Levine. 1990. “Credibility and Trust in Risk Communication.” In Communicating Risks to the Public: International Perspectives, ed. by Roger E. Kasperson, and Pieter Jan M. Stallen, 175–217. Dordrecht: Kluwer Academic Publishers.Google Scholar logo with link to Google Scholar
Rogers, Everett M., and Dilip K. Bhowmik. 1970. “Homophily-Heterophily: Relational Concepts for Communication Research.” Public Opinion Quarterly 34 (4): 523–38. Google Scholar logo with link to Google Scholar
Siegrist, Michael. 2021. “Trust and Risk Perception: A Critical Review of the Literature.” Risk Analysis 41 (3): 480–90. Google Scholar logo with link to Google Scholar
Smith, E. Keith, and Adam Mayer. 2018. “A Social Trap for the Climate? Collective Action, Trust and Climate Change Risk Perception in 35 Countries.” Global Environmental Change 49: 140–53. Google Scholar logo with link to Google Scholar
Spence, Patric R., Kenneth A. Lachlan, David Westerman, and Stephen A. Spates. 2013. “Where the Gates Matter Less: Ethnicity and Perceived Source Credibility in Social Media Health Messages.” Howard Journal of Communications 24 (1): 1–16. Google Scholar logo with link to Google Scholar
Sperber, Matthias, and Matthias Paulik. 2020. “Speech Translation and the End-to-End Promise: Taking Stock of Where We Are.” arXiv:2004.06358, Google Scholar logo with link to Google Scholar
Sundar, S. Shyam, and Clifford Nass. 2001. “Conceptualizing Sources in Online News.” Journal of Communication 51 (1): 52–72. Google Scholar logo with link to Google Scholar
Tajfel, Henri. 1981. Human Groups and Social Categories. Cambridge: Cambridge University Press.Google Scholar logo with link to Google Scholar
Tajfel, Henri, and John C. Turner. 2004. “The Social Identity Theory of Intergroup Behavior.” In Political Psychology, ed. by John T. Jost, and Jim Sidanius, 276–93. New York: Psychology Press. Google Scholar logo with link to Google Scholar
Wang, Zuoming, Joseph B. Walther, Suzanne Pingree, and Robert P. Hawkins. 2008. “Health Information, Credibility, Homophily, and Influence via the Internet: Web Sites versus Discussion Groups.” Health Communication 23 (4): 358–68. Google Scholar logo with link to Google Scholar
Wathen, C. Nadine, and Jacquelyn Burkell. 2002. “Believe It or Not: Factors Influencing Credibility on the Web.” Journal of the American Society for Information Science and Technology 53 (2): 134–44. Google Scholar logo with link to Google Scholar
Wilson, Elizabeth J., and Daniel L. Sherrell. 1993. “Source Effects in Communication and Persuasion Research: A Meta-Analysis of Effect Size.” Journal of the Academy of Marketing Science 21 (2): 101–12. Google Scholar logo with link to Google Scholar
Wu, Yonghui, Mike Schuster, Zhifeng Chen, Quoc V. Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, et al. 2016. “Google’s Neural Machine Translation System: Bridging the Gap between Human and Machine Translation.” arXiv:1609.08144, [URL]
Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue