Cover not available

Article published In: Language and Covid-19
Edited by Michaela Mahlberg and Gavin Brookes
[International Journal of Corpus Linguistics 26:4] 2021
► pp. 498–531

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
authorization required

Communicating the unknown

An interdisciplinary annotation study of uncertainty in the coronavirus pandemic

ORCiD logo with link | TU Darmstadt
ORCiD logo with link | TU Darmstadt
ORCiD logo with link | University of Melbourne
Published online: 23 August 2021
DOI logo with link
https://doi.org/10.1075/ijcl.21096.mul
Abstract
This paper presents an annotation approach to examine uncertainty in British and German newspaper articles on the coronavirus pandemic. We develop a tagset in an interdisciplinary team from corpus linguistics and sociology. After working out a gold standard on a pilot corpus, we apply the annotation to the entire corpus drawing on an “annotation-by-query” approach in CQPWeb, based on uncertainty constructions that have been extracted from the gold standard data. The annotated data are then evaluated and sociologically contextualised. On this basis, we study the development of uncertainty markers in the period under study and compare media discourses in Germany and the UK. Our findings reflect the different courses of the pandemic in Germany and the UK as well as the different political responses, media traditions and cultural concerns: While markers of fear are more important in British discourse, we see a steadily increasing level of disagreement in German discourse. Other forms of uncertainty such as ‘possibility’ or ‘probability’ are similarly frequent in both discourses.
Article outline
  • 1.Introduction
  • 2.Uncertainty in media discourses on COVID-19
    • 2.1Concepts of uncertainty
    • 2.2Linguistic uncertainty markers
  • 3.Methodology
    • 3.1Corpus and tools
    • 3.2Annotation scheme and gold standard development
    • 3.3Annotation by query: Extraction of constructions and operationalisation
      • 3.3.1Indications of personal uncertainty
        • Anxiety
        • Disagreement
        • Doubt
        • Ignorance
        • Presumption
      • 3.3.2Indications of situational uncertainty
        • Danger
        • Opportunity
        • Possibility
        • Probability
        • Vagueness
      • 3.3.3Operationalisation: CQL queries
  • 4.Results
    • 4.1Personal uncertainty markers
    • 4.2Situational uncertainty markers
  • 5.Conclusions
  • Acknowledgements
  • References
References (53)
References
Adams, J. (2016). Risk and culture. In A. Burgess, A. Alemanno, & J. O. Zinn (Eds.), Routledge Handbook of Risk Studies (pp. 83–93). Routledge.Google Scholar logo with link to Google Scholar
Bednarek, M. (2006). Evaluation in Media Discourse: Analysis of a Newspaper Corpus. Continuum.Google Scholar logo with link to Google Scholar
Biber, D., & Finegan, E. (1989). Styles of stance in English: Lexical and grammatical marking of evidentiality and affect. Text & Talk, 9(1), 93–124. Google Scholar logo with link to Google Scholar
Boholm, M. (2012). The semantic distinction between “risk” and “danger”: A linguistic analysis. Risk Analysis, 32(2), 281–293. Google Scholar logo with link to Google Scholar
Boogaart, R., & Fortuin, E. (2016). Modality and mood in cognitive linguistics and construction grammars. In J. Nuyts & J. Van der Auwera (Eds.), Oxford Handbook of Modality and Mood (pp. 514–533). Oxford University Press.Google Scholar logo with link to Google Scholar
Collins, L., & Nerlich, B. (2016). Uncertainty discourses in the context of climate change: A corpus-assisted analysis of UK national newspaper articles. Communications – the European Journal of Communication Research, 41(3), 291–313. Google Scholar logo with link to Google Scholar
Covello, V. T. (2009). Strategies for overcoming challenges to effective risk communication. In R. L. Heath & H. D. O’Hair (Eds.), Handbook of Risk and Crisis Communication (pp. 143–167). Routledge.Google Scholar logo with link to Google Scholar
DF (Deutschlandfunk). (2020, February 27). “Große Unsicherheit, die wir alle teilen.” Marlis Prinzing im Gespräch mit Sebastian Wellendorf. [“Great uncertainty that we all share.” Marlis Prinzing in conversation with Sebastian Wellendorf]. [URL]
Eckart de Castilho, R., Bartsch, S., & Gurevych, I. (2012). CSNIPER – Annotation-by-query for non-canonical constructions in large corpora. In M. Zhang (Ed.), Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (pp. 85–90). Association for Computational Linguistics. [URL]
Evert, S., & The CWB Development Team. (2020). The IMS Corpus Workbench (CWB): CQP Query Language Tutorial. CWB Version. [URL]
Fischhoff, B. (1998). Risk perception and communication unplugged: Twenty years of process. In R. Löfstedt & L. Frewer (Eds.), The Earthscan Reader in Risk and Modern Society (pp. 133–148). Earthscan.Google Scholar logo with link to Google Scholar
Francis, G., Hunston, S., & Manning, E. (1998). Collins Cobuild Grammar Patterns 2: Nouns and Adjectives. HarperCollins.Google Scholar logo with link to Google Scholar
Gesser-Edelsburg, A., & Shir-Raz, Y. (2018). Communicating risk for issues that involve ‘uncertainty bias’: What can the Israeli case of water fluoridation teach us? Journal of Risk Research, 21(4), 395–416. Google Scholar logo with link to Google Scholar
Greve, W., & Wentura, D. (1997). Wissenschaftliche Beobachtung: Eine Einführung [Scientific Observation: An Introduction]. PVU/Beltz.Google Scholar logo with link to Google Scholar
Gross, M. (2007). The unknown in process: Dynamic connections of ignorance, non-knowledge and related concepts. Current Sociology, 55(5), 742–59. Google Scholar logo with link to Google Scholar
Hacquard, V., & Wellwood, A. (2012). Embedding epistemic modals in English: A corpus-based study. Semantics and Pragmatics, 5(4), 1–29. Google Scholar logo with link to Google Scholar
Hamilton, C., Adolphs, S., & Nerlich, B. (2007). The meanings of ‘risk’: A view from corpus linguistics. Discourse & Society, 18(2), 163–181. Google Scholar logo with link to Google Scholar
Hosinner, M. (2020, March 11). Alles nur Panikmache der bösen Medien? [All just scaremongering by the evil media?] Heidenheimer Zeitung. [URL]
Hunston, S. (2011). Corpus Approaches to Evaluation: Phraseology and Evaluative Language. Routledge.Google Scholar logo with link to Google Scholar
Hunter, D. J. (2020). Covid-19 and the stiff upper lip – the pandemic response in the United Kingdom. New England Journal of Medicine, 382(16), e31. Google Scholar logo with link to Google Scholar
Jaspal, R., & Nerlich, B. (2020). Social representations, identity threat, and coping amid COVID-19. Psychological Trauma: Theory, Research, Practice, and Policy, 12(S1), S249–S251. Google Scholar logo with link to Google Scholar
Johnson, C. R., Petruck, M. R. L., Baker, C. F., Ellsworth, M., Ruppenhofer, J., & Fillmore, C. F. (2003). FrameNet: Theory and Practice. Version 1.1. [URL]
Juanchich, M., Gourdon-Kanhukamwe, A., & Sirota, M. (2017). “I am uncertain” vs “It is uncertain”: How linguistic markers of the uncertainty source affect uncertainty communication. Judgment and Decision Making, 12(5), 445–465.Google Scholar logo with link to Google Scholar
Kahneman, D., & Tversky, A. (1982). Variants of uncertainty. Cognition, 11(2), 143–157. Google Scholar logo with link to Google Scholar
Klie, J.-C., Eckart de Castilho, R., & Gurevych, I. (2020). From zero to hero: Human-in-the-loop entity linking in low resource domains. In D. Jurafsky, J. Chai, N. Schluter, & J. Tetreault (Eds.), Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics (pp. 6982–6993). Association for Computational Linguistics. [URL].
Knight, F. H. (1921). Risk, Uncertainty and Profit. University of Chicago Press.Google Scholar logo with link to Google Scholar
Kratzer, A. (1981). The notional category of modality. In H.-J. Eikmeyer & H. Rieser (Eds.), Words, Worlds, and Contexts (pp. 38–74). De Gruyter. Google Scholar logo with link to Google Scholar
(1991). Modality. In A. von Stechow & D. Wunderlich (Eds.), Semantics: An International Handbook of Contemporary Research (pp. 639–650). Mouton de Gruyter.Google Scholar logo with link to Google Scholar
Lagnado, D. A., & Sloman, S. A. (2004). Inside and outside probability judgment. In D. J. Koehler & N. Harvey (Eds.), Blackwell Handbook of Judgment and Decision Making (pp. 155–176). Blackwell. Google Scholar logo with link to Google Scholar
Luhmann, N. (1993). Risk: A Sociological Theory. De Gruyter.Google Scholar logo with link to Google Scholar
Lupton, D. (2013). Risk and emotion: Towards an alternative theoretical perspective. Health, Risk & Society, 15(8), 634–47. Google Scholar logo with link to Google Scholar
McEnery, T., & Kifle, N. A. (2002). Epistemic modality in argumentative essays of second-language writers. In J. Flowerdew (Ed.), Academic Discourse (pp. 182–215). Longman.Google Scholar logo with link to Google Scholar
Müller, M., & Stegmeier, J. (2019). Investigating risk, uncertainty and normativity within the framework of Digital Discourse Analysis: The example of future technologies in climate change discourse. In A. Olofsson & J. O. Zinn (Eds.), Researching Risk and Uncertainty – Methodologies, Methods and Research Strategies (pp. 309–335). Palgrave. Google Scholar logo with link to Google Scholar
Palmer, F. R. (1986). Mood and Modality. Cambridge University Press.Google Scholar logo with link to Google Scholar
Pidgeon, N., Hood, C., Jones, D., Turner, B., & Gibson, R. (1992). Risk perception. In The Royal Society Study Group (Ed.), Risk: Analysis, Perception and Management (pp. 89–134). The Royal Society.Google Scholar logo with link to Google Scholar
Quandt, T., Boberg, S., Schatto Eckrodt, T., & Frischlich, L. (2020). Pandemic News: Facebook pages of mainstream news media and the coronavirus crisis – a computational content analysis. Münster Online Research (MOR), Working Paper 2 (2020). [URL]
Renn, O. (2008). Risk Governance: Coping with Uncertainty in a Complex World. Earthscan. Google Scholar logo with link to Google Scholar
Sandman, P., & Lanard, J. (2011). Explaining and proclaiming uncertainty: Risk communication lessons from Germany’s deadly E. coli outbreak. Risk=Hazard+Outrage: The Peter M. Sandman Risk Communication Website. [URL]
Scally, G., Jacobson, B., & Abbasi, K. (2020). The UK’s public health response to covid-19. BMJ, 369, m1932. Google Scholar logo with link to Google Scholar
Tagesschau. (2020, March 20). Wirtschaft versus Gesundheit [Economy versus health]. Tagesschau.de. [URL]
Tang, C., & Rundblad, G. (2017). When safe means ‘dangerous’: A corpus investigation of risk communication in the media. Applied Linguistics, 38(5), 666–687. Google Scholar logo with link to Google Scholar
Teruel, M., Cardellino, C., Cardellino, F., Alonso Alemany, L., & Villata, S. (2018). Increasing argument annotation reproducibility by using inter-annotator agreement to improve guidelines. In N. Calzolari, N. Calzolari, K. Choukri, C. Cieri, T. Declerck, S. Goggi, K. Hasida, H. Isahara, B. Maegaard, J. Mariani, H. Mazo, A. Moreno, J. Odijk, S. Piperidis, & T. Tokunaga (Eds.), Proceedings of the 11th International Conference on Language Resources and Evaluation (LREC) (pp. 4061–4064). Association for Computational Linguistics. [URL]
Teigen, K. H. (1988). The language of uncertainty. Acta Psychologica, 68(1–3), 27–38. Google Scholar logo with link to Google Scholar
Thompson, G., & Hunston, S. (1999). Evaluation: An introduction. In S. Hunston & E. Thompson (Eds.), Evaluation in Text: Authorial Stance and the Construction of Discourse (pp. 1–26). Oxford University Press.Google Scholar logo with link to Google Scholar
WHO (World Health Organization). (2017). Communication risk in public health emergencies. A WHO guideline for emergency risk communication (ERC) policy and practice. World Health Organization. [URL]
Zinn, J. O. (2009). A comparison of sociological theorizing on risk and uncertainty. In J. O. Zinn (Ed.), Social Theories of Risk and Uncertainty (pp. 168–210). Blackwell.Google Scholar logo with link to Google Scholar
(2016). ‘In-between’ and other reasonable ways to deal with risk and uncertainty. Health, Risk & Society, 18(7–8), 348–66. Google Scholar logo with link to Google Scholar
(2020a). ‘A monstrous threat’: How a state of exception turns into a ‘new normal’. Journal of Risk Research, 23(7–8), 1083–1091. Google Scholar logo with link to Google Scholar
(2020b). The UK ‘at Risk’: A Corpus Approach to Historical Social Change 1785–2009. Palgrave. Google Scholar logo with link to Google Scholar
Zinn, J. O., & McDonald, D. (2018). Risk in The New York Times (1987–2014): A Corpus-Based Exploration of Sociological Theories. Palgrave. Google Scholar logo with link to Google Scholar
Cited by (11)

Cited by 11 other publications

Kiemes, Carina, Marcus Müller & Martin Wengeler
2025. The analysis of argumentation topoi. Nota Bene 2:1 ► pp. 106 ff. DOI logo
Ningrum, Panggih Kusuma, Philipp Mayr, Nina Smirnova & Iana Atanassova
2025. Annotating scientific uncertainty: A comprehensive model using linguistic patterns and comparison with existing approaches. Journal of Informetrics 19:2 ► pp. 101661 ff. DOI logo
Yan, Ni & Marcus Müller
2025. What is German ‘Angst’ (fear/anxiety)? A corpus approach based on frame analysis. Language and Cognition 17 DOI logo
Zou, Hang (Joanna) & Ken Hyland
2024. Stance in article highlights: The promotion of Covid‐19 research. International Journal of Applied Linguistics 34:2 ► pp. 466 ff. DOI logo
Bondi, Marina & Jessica Jane Nocella
2023. Boosting Booster Trust: Negotiating a Jungle of Misinformation. Lingue Culture Mediazioni - Languages Cultures Mediation (LCM Journal) 10:2 DOI logo
Leone, Ljubica
2023. The representations of freedom in The Sun newspaper between 2019 and 2021: A corpus-based study. Topics in Linguistics 24:1 ► pp. 43 ff. DOI logo
Robinson, Justyna A., Rhys J. Sandow & Roberta Piazza
2023. Introducing the keyconcept approach to the analysis of language: the case of regulation in COVID-19 diaries. Frontiers in Artificial Intelligence 6 DOI logo
Müller, Marcus
2022. Discourse Lab – eine Forschungsplattform für die digitale Diskursanalyse. Mitteilungen des Deutschen Germanistenverbandes 69:2 ► pp. 152 ff. DOI logo
Müller, Marcus
2024. Einsam oder gemeinsam?. Zeitschrift für Literaturwissenschaft und Linguistik 54:2 ► pp. 151 ff. DOI logo
Ratcliff, Chelsea L., Rebekah Wicke & Blue Harvill
2022. Communicating uncertainty to the public during the COVID-19 pandemic: A scoping review of the literature. Annals of the International Communication Association 46:4 ► pp. 260 ff. DOI logo
Zinn, Jens O. & Marcus Müller
2022. Understanding discourse and language of risk. Journal of Risk Research 25:3 ► pp. 271 ff. DOI logo

This list is based on CrossRef data as of 12 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue