Significant or random?: A critical review of sociolinguistic generalisations based on large corpora

Brezina, Vaclav; Meyerhoff, Miriam

doi:10.1075/ijcl.19.1.01bre

Article published In: International Journal of Corpus Linguistics
Vol. 19:1 (2014) ► pp.1–28

Get fulltext from our e-platform

Download PDF

Significant or random?

A critical review of sociolinguistic generalisations based on large corpora

Vaclav Brezina | Lancaster University

Miriam Meyerhoff | Victoria University of Wellington

Published online: 18 April 2014

https://doi.org/10.1075/ijcl.19.1.01bre

References (49)

Anderwald, L. 2002. Negation in Non-standard British English . London: Routledge.

2005. “Negative concord in British English dialects”. In Y. Yieiri (Ed.), Aspects of English Negation .Amsterdam: John Benjamins, 113-138.

Baker, P. 2010. Sociolinguistics and Corpus Linguistics . Edinburgh: Edinburgh University Press.

Barbieri, F. 2008. “Patterns of age-based linguistic variation in American English. ” Journal of Sociolinguistics , 12 (1), 58-88.

Barlow, M. 2002. MonoConc Pro 2.0 . Houston: Athelstan Publications.

Biber, D. 1991 [1988]. Variation Across Speech and Writing . Cambridge: Cambridge University Press.

2009. “A corpus-driven approach to formulaic language in English: Multi-word patterns in speech and writing”. International Journal of Corpus Linguistics , 14 (3), 275-311.

Biber, D., S. Conrad & R. Reppen. 1998. Corpus Linguistics: Investigating Language Structure and Use . Cambridge: Cambridge University Press.

Biber, D., S. Johansson, G. Leech, S. Conrad, E. Finegan & R. Quirk. 1999. Longman Grammar of Spoken and Written English . Harlow: Longman.

Brezina, V. 2013. “Certainty and uncertainty in spoken language: In search of epistemic sociolect and idiolect.” In M. Reif, J. Robinson & M. Pütz (Eds.) Variation in Language and Language Use , Frankfurt am Mein: Peter Lang, 97-107.

Bucholtz, M. 1999. ‘“Why be normal?’ Language and identity practices in a community of nerd girls”. Language in Society , 28 (2): 203-223.

Chambers, J.K. 2003. Sociolinguistic Theory: Linguistic Variation and its Social Implications . Oxford: Blackwell.

Cheshire, J. 1992. Variation in an English Dialect: A Sociolinguistic Study . Cambridge: Cambridge University Press.

Deutschmann, M. 2003. Apologising in British English . Umeå: Umeå Universitet.

Eckert, P. 1989. “The whole woman: Sex and gender differences in variation”. Language Variation and Change , 1 (3): 245-267.

2000. Linguistic Variation as Social Practice . Oxford: Blackwell.

Field, A. 2009. Discovering Statistics Using SPSS . London: SAGE.

Gibbons, J. D. & S. Chakraborti. 2003. Nonparametric Statistical Inference . New York: Marcel Dekker.

Gries, S. T. 2005. “Null-hypothesis significance testing of word frequencies: A follow-up on Kilgarriff.” Corpus Linguistics and Linguistic Theory , 1 (2), 277-294.

2006. “Some proposals towards more rigorous corpus linguistics. ” Zeitschrift für Anglistik und Amerikanistik , 54 (2), 191–202.

Holmes, J. 1995a. “Time for /t/: Initial /t/ in New Zealand English.” Australian Journal of Linguistics , 15 (2),127-156.

1995b. Women, Men and Politeness . London: Longman.

Hunston, S. & G. Francis. 2000. Pattern Grammar: A Corpus-driven Approach to the Lexical Grammar of English . Amsterdam: John Benjamins.

Ito, R. & Tagliamonte, S. 2003. “ Well weird, right dodgy, very strange, really cool: Layering and recycling in English intensifiers”. Language in Society , 321, 257-279.

Johnson, D. E. 2009. “Getting off the GoldVarb standard: Introducing Rbrul for mixed-effects variable rule analysis”. Language and Linguistics Compass , 3 (1), 359-383.

Kiesling, S. F. 1998. “Men’s identities and sociolinguistic variation: The case of fraternity men”. Journal of Sociolinguistics , 2 (1), 69-99.

Kilgarriff, A. 2001. “Comparing corpora. ” International Journal of Corpus Linguistics , 6 (1), 97-133.

2005. “Language is never, ever, ever, random. ” Corpus Linguistics and Linguistic Theory , 1 (2), 263-276.

Macaulay, R. 2002. “You know, it depends. ” Journal of Pragmatics , 34 (6), 749-767.

Mann, H. B. & Whitney, D. R. 1947. “On a test of whether one of two random variables is stochastically larger than the other. ” The Annals of Mathematical Statistics , 18 (1), 50-60.

McEnery, A. & Hardie, A.. 2012. Corpus Linguistics: Method, Theory and Practice . Cambridge: Cambridge University Press.

McEnery, A. & Xiao, Z. 2004. “Swearing in modern British English: The case of fuck in the BNC. ” Language and Literature , 13 (3), 235-268.

Meyerhoff, M. 1999. “Sorry in the Pacific: Defining communities, defining practices”. Language in Society , 28 (2), 225-238.

Murphy, B. 2009. “‘She’s a fucking ticket’: the pragmatics of fuck in Irish English: An age and gender perspective. ” Corpora , 4 (1), 85-106.

2010. Corpus and Sociolinguistics: Investigating Age and Gender in Female Talk . Amsterdam: John Benjamins.

Nevalainen, T. 1999. “Making the best use of ‘bad’ data: Evidence for sociolinguistic variation in Early Modern English”. Neuphilologische Mitteilungen , 100 (4), 499-533.

Nevalainen, T. & Raumolin-Brunberg, H. 2003. Historical Sociolinguistics . London: Longman.

Nickerson, R. S. 2000. “Null hypothesis significance testing: A review of an old and continuing controversy. ” Psychological Methods , 5 (2), 241.

Rayson, P., Berridge, D. & Francis, B. 2004. “Extending the Cochran rule for the comparison of word frequencies between corpora.” In G. Purnelle, C. Fairon & A. Dister (Eds.) Le Poids des Mots: Proceedings of the 7th International Conference on Statistical analysis of textual data (JADT 2004), Louvain-la-Neuve: Presses universitaires de Louvain, 926-936.

Rayson, P., Leech, G. & Hodges, M. 1997. “Social differentiation in the use of English vocabulary: Some analyses of the conversational component of the British National Corpus. ” International Journal of Corpus Linguistics , 2 (1), 133-152.

Schmid, H.-J. 2003. “Do women and men really live in different cultures? Evidence from the BNC.” In A. Wilson, P. Rayson & T. McEnery (Eds.) Corpus Linguistics by the Lune. A Festschrift for Geoffrey Leech . Frankfurt: Peter Lang, 185-221.

Scott, M. 2001. “Comparing corpora and identifying key words, collocations, and frequency distributions through the WordSmith Tools suite of computer programs”. In M. Ghadessy, A. Henry & R. L. Roseberry (Eds.) Small Corpus Studies and ELT: Theory and Practice . John Benjamins: Amsterdam, 47-67.

1997. “PC analysis of key words – and key key words”. System , 25 (2), 233-245.

Sinclair, J. 1991. Corpus, Concordance, Collocation . Oxford: Oxford University Press.

Smith, J. 2001. “Negative concord in the Old and New World: Evidence from Scotland”. Language Variation and Change , 13(2), 109-134.

Stubbs, M. 2001. “Texts, corpora, and problems of interpretation: A response to Widdowson. ” Applied Linguistics , 22 (2), 149-172.

Torgersen, E. N., Gabrielatos, C., Hoffmann, S. & Fox, S. 2011. “A corpus-based study of pragmatic markers in London English”. Corpus Linguistics and Linguistic Theory , 7 (1), 93-118.

Widdowson, H. G. 2000. “On the limitations of linguistics applied. ” Applied Linguistics , 21 (1), 3-25.

Xiao, R., & Tao, H. 2007. “A corpus-based sociolinguistic study of amplifiers in British English. ” Sociolinguistic Studies , 1 (2), 241-273.

Cited by (63)

Cited by 63 other publications

Order by:

Fekete, István

2025. Application of MID in Biology. In Transforming Data into Informed Decisions across Clinical and Non-Clinical Domains, ► pp. 165 ff.

Fekete, István

2025. MID in the Business Sector. In Transforming Data into Informed Decisions across Clinical and Non-Clinical Domains, ► pp. 177 ff.

Fekete, István

2025. MID in the Social Sciences, Linguistics, Education Sciences, and Sociology. In Transforming Data into Informed Decisions across Clinical and Non-Clinical Domains, ► pp. 145 ff.

Fekete, István

2025. Theoretical Foundations of MCID and MID: Put the Patient or Client at the Forefront. In Transforming Data into Informed Decisions across Clinical and Non-Clinical Domains, ► pp. 11 ff.

Fekete, István

2025. Introduction to Minimal Clinically Important Difference (MCID) and Minimal Important Difference (MID). In Transforming Data into Informed Decisions across Clinical and Non-Clinical Domains, ► pp. 1 ff.

Flanagan, Joseph

2025. Reproducibility, replicability, robustness, and generalizability in corpus linguistics. International Journal of Corpus Linguistics 30:2 ► pp. 130 ff.

Hwang, Haerim & Hyunwoo Kim

2025. Genre-specific features of second language speech: connectives in exposition and narration. Applied Linguistics Review

McKee, Rachel, Mireille Vale, George Major, Sara Pivac Alexander & Miriam Meyerhoff

2025. “Two hands are powerful”. Handedness variation and genre in New Zealand Sign Language. Language & Communication 100 ► pp. 60 ff.

P. Romasanta, Raquel

2025. A dialectological approach to complement variability in global web-based English. Research in Corpus Linguistics 13:1 ► pp. 197 ff.

Zimmermann, Richard

2025. Measuring Language Change in Diachronic Corpora. In Reference Module in Social Sciences,

Bendík, Lukáš

2024. Šesť idiolektov, jeden seriál: komparatívna analýza prekladu vulgarizmov v seriáli Yellowjackets. NOVÁ FILOLOGICKÁ REVUE 16:1 ► pp. 140 ff.

Juszczyk, Konrad & Barbara Konat

2024. The use of discourse markers in conversation: The case of “myślę” – “I think” in Polish Career Clean Coaching. Lingua Posnaniensis 66:1 ► pp. 7 ff.

Martynova, Maria, Yulia Zuban, Natalia Gagarina & Luka Szucsich

2024. Use of Embedded Clauses in Heritage and Monolingual Russian. Languages 9:5 ► pp. 157 ff.

Smith, Nicholas, Cristiano Broccias & Cathleen Waters

2024. Addressing comparability and retrieval issues in conversation corpora: A case study on the spoken British National Corpora (1994 and 2014), using the past perfect. Research in Corpus Linguistics 12:2 ► pp. 80 ff.

Sönning, Lukas

2024. Evaluation of keyness metrics: performance and reliability. Corpus Linguistics and Linguistic Theory 20:2 ► pp. 263 ff.

Wulff, Stefanie & Stefan Th. Gries

2024. CLLT ‘versus’ Corpora and IJCL: a (half serious) keyness analysis. Corpus Linguistics and Linguistic Theory 20:3 ► pp. 461 ff.

Gillings, Mathew, Gerlinde Mautner & Paul Baker

2023. Corpus-Assisted Discourse Studies,

Lin, Li, Kunmei Han, Jia Wen Hing, Luwen Cao, Vincent Ooi, Nick Huang & Zhiming Bao

2023. Tagging Singapore English. World Englishes 42:4 ► pp. 624 ff.

Brezina, Vaclav, Dana Gablasova & Tony McEnery

2022. Corpus-based approaches to spoken L2 production. International Journal of Learner Corpus Research ► pp. 119 ff.

Love, Robbie, Claire Dembry, Andrew Hardie, Vaclav Brezina & Tony McEnery

2022. The Spoken BNC2014. International Journal of Corpus Linguistics ► pp. 319 ff.

Matthews, Adam & Ben Kotzee

2022. Bundled or unbundled? A multi‐text corpus‐assisted discourse analysis of the relationship between teaching and research in UK universities. British Educational Research Journal 48:3 ► pp. 578 ff.

Rayson, Paul

2022. Corpus Analysis of Key Words. In The Encyclopedia of Applied Linguistics, ► pp. 1 ff.

Csomay, Eniko & Ryan Young

2021. Language use in pop culture over three decades. International Journal of Corpus Linguistics 26:1 ► pp. 71 ff.

Gauthier, Michael

2021. ‘Eww wtf, what a dumb bitch’: a case study of similitudes inside gender-specific swearing patterns on Twitter. Corpora 16:1 ► pp. 31 ff.

Love, Robbie

2021. Swearing in informal spoken English: 1990s–2010s. Text & Talk 41:5-6 ► pp. 739 ff.

LOVE, ROBBIE & NIALL CURRY

2021. Recent change in modality in informal spoken British English: 1990s–2010s. English Language and Linguistics 25:3 ► pp. 537 ff.

Winter, Bodo & Paul‐Christian Bürkner

2021. Poisson regression for linguists: A tutorial introduction to modelling count data with brms. Language and Linguistics Compass 15:11

Winter, Bodo & Martine Grice

2021. Independence and generalizability in linguistics. Linguistics 59:5 ► pp. 1251 ff.

Güngör, Fatih & Hacer Hande Uysal

2020. Lexical bundle use and crosslinguistic influence in academic texts. Lingua 242 ► pp. 102859 ff.

Rayson, Paul & Amanda Potts

2020. Analysing Keyword Lists. In A Practical Handbook of Corpus Linguistics, ► pp. 119 ff.

Yao, Xinyue

2020. Idiomaticity in Intercultural Communication in English as Lingua Franca: A Corpus-based Study of Verb-Object Combinations. In Corpus-based Approaches to Grammar, Media and Health Discourses [The M.A.K. Halliday Library Functional Linguistics Series, ], ► pp. 73 ff.

Castello, Erik & Sara Gesuato1

2019. Holding up one’s end of the conversation in spoken English. International Journal of Learner Corpus Research 5:2 ► pp. 231 ff.

Kaunisto, Mark & Juhani Rudanko

2019. Exceptions to Bach’s Generalization in Inner and Outer Core Varieties of English: The Case of Warn Against -ing. In Variation in Non-finite Constructions in English, ► pp. 81 ff.

Koplenig, Alexander & Gareth J. Baxter

2019. A non-parametric significance test to compare corpora. PLOS ONE 14:9 ► pp. e0222703 ff.

Liu, Chen-Yu & Howard Hao-Jan Chen

2019. Academic Spoken Vocabulary in TED Talks: Implications for Academic Listening. English Teaching & Learning 43:4 ► pp. 353 ff.

Smith, Nicholas & Cathleen Waters

2019. Variation and change in a specialized register. International Journal of Corpus Linguistics 24:2 ► pp. 169 ff.

Tidwell, Jacqueline Hettel

2019. From a Smoking Gun to Spent Fuel: Principled Subsampling Methods for Building Big Language Data Corpora from Monitor Corpora. Data 4:2 ► pp. 48 ff.

Baclawski, Kenneth

2018. Diglossia and change from below in Eastern Cham. Asia-Pacific Language Variation 4:1 ► pp. 73 ff.

Barlow, Michael

2018. The individual and the group from a corpus perspective. In The Corpus Linguistic Discourse [Studies in Corpus Linguistics, 87], ► pp. 163 ff.

Brezina, Vaclav

2018. Statistics in Corpus Linguistics,

Brezina, Vaclav

2020. Classical Monofactorial (Parametric and Non-parametric) Tests. In A Practical Handbook of Corpus Linguistics, ► pp. 473 ff.

Fuchs, Robert

2017. Do women (still) use more intensifiers than men?. International Journal of Corpus Linguistics 22:3 ► pp. 345 ff.

Gablasova, Dana, Vaclav Brezina, Tony Mcenery & Elaine Boyd

2017. Epistemic Stance in Spoken L2 English: The Effect of Task and Speaker Style. Applied Linguistics 38:5 ► pp. 613 ff.

Gablasova, Dana, Vaclav Brezina & Tony McEnery

2017. Exploring Learner Language Through Corpora: Comparing and Interpreting Corpus Frequency Information. Language Learning 67:S1 ► pp. 130 ff.

Gablasova, Dana, Vaclav Brezina & Tony McEnery

2022. The Trinity Lancaster Corpus. International Journal of Learner Corpus Research ► pp. 126 ff.

Gauthier, Michael & Adrien Guille

2017. Chapter 6. Gender and age differences in swearing. In Advances in Swearing Research [Pragmatics & Beyond New Series, 282], ► pp. 137 ff.

Laws, Jacqueline, Chris Ryder & Sylvia Jaworska

2017. A diachronic corpus-based study into the effects of age and gender on the usage patterns of verb-forming suffixation in spoken British English. International Journal of Corpus Linguistics 22:3 ► pp. 375 ff.

Paquot, Magali & Luke Plonsky

2017. Quantitative research methods and study quality in learner corpus research. International Journal of Learner Corpus Research 3:1 ► pp. 61 ff.

Rudanko, Juhani

2017. Non-Finite Complements of the Verb Consent in Current American and British English. In Infinitives and Gerunds in Recent English, ► pp. 11 ff.

Säily, Tanja, Arja Nurmi, Minna Palander-Collin & Anita Auer

2017. The future of historical sociolinguistics?. In Exploring Future Paths for Historical Sociolinguistics [Advances in Historical Sociolinguistics, 7], ► pp. 1 ff.

Koplenig, Alexander, Carolin Müller-Spitzer & Karen Lidzba

2016. Population Size Predicts Lexical Diversity, but so Does the Mean Sea Level – Why It Is Important to Correctly Account for the Structure of Temporal Data. PLOS ONE 11:3 ► pp. e0150771 ff.

Bednarek, Monika

2015. “Wicked” women in contemporary pop culture: “bad” language and gender in Weeds, Nurse Jackie, and Saving Grace . Text & Talk 35:4 ► pp. 431 ff.

Gablasova, Dana & Vaclav Brezina

2015. Does Speaker Role Affect the Choice of Epistemic Adverbials in L2 Speech? Evidence from the Trinity Lancaster Corpus. In Yearbook of Corpus Linguistics and Pragmatics 2015 [Yearbook of Corpus Linguistics and Pragmatics, 3], ► pp. 117 ff.

Koplenig, Alexander

2015. The Impact of Lacking Metadata for the Measurement of Cultural and Linguistic Change Using the Google Ngram Data Sets—Reconstructing the Composition of the German Corpus in Times of WWII. Digital Scholarship in the Humanities ► pp. fqv037 ff.

Koplenig, Alexander

2019. Against statistical significance testing in corpus linguistics. Corpus Linguistics and Linguistic Theory 15:2 ► pp. 321 ff.

Mukherjee, Joybrato

2015. Response to Davies and Fuchs. English World-Wide. A Journal of Varieties of English 36:1 ► pp. 34 ff.

[no author supplied]

2018. Bringing Everything Together. In Statistics in Corpus Linguistics, ► pp. 257 ff.

[no author supplied]

2018. Compliments and Positive Assessments [Pragmatics & Beyond New Series, 289],

[no author supplied]

2018. Sociolinguistics and Stylistics. In Statistics in Corpus Linguistics, ► pp. 183 ff.

[no author supplied]

2018. Patterns of Change in 18th-century English [Advances in Historical Sociolinguistics, 8],

[no author supplied]

2023. Language and Characterisation in Television Series [Studies in Corpus Linguistics, 106],

[no author supplied]

2024. Frequency, Dispersion, Association, and Keyness [Studies in Corpus Linguistics, 115],

[no author supplied]

2024. The Present Perfect and the Preterite in Late Modern and Contemporary English [Studies in Corpus Linguistics, 114],

This list is based on CrossRef data as of 12 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.