Article published In: Journal of Language Aggression and Conflict
Vol. 7:2 (2019) ► pp.240–268
Online hatred of women in the Incels.me forum
Linguistic analysis and automatic detection
Published online: 8 July 2019
https://doi.org/10.1075/jlac.00026.jak
https://doi.org/10.1075/jlac.00026.jak
Abstract
This paper presents a study of the (now suspended) online discussion forum Incels.me and its users, involuntary celibates or incels, a virtual community of isolated men without a sexual life, who see women as the cause of their problems and often use the forum for misogynistic hate speech and other forms of incitement. Involuntary celibates have attracted media attention and concern, after a killing spree in April 2018 in Toronto, Canada. The aim of this study is to shed light on the group dynamics of the incel community, by applying mixed-methods quantitative and qualitative approaches to analyze how the users of the forum create in-group identity and how they construct major out-groups, particularly women. We investigate the vernacular used by incels, apply automatic profiling techniques to determine who they are, discuss the hate speech posted in the forum, and propose a Deep Learning system that is able to detect instances of misogyny, homophobia, and racism, with approximately 95% accuracy.
Keywords: misogyny, hate speech, social media, forensic linguistics, text analytics, text profiling
Article outline
- 1.Introduction
- 2.State-of-the-art
- 3.Methods and materials
- 3.1Aim of the study and research questions
- 3.2Materials
- 3.3Methods
- 4.Text analysis
- 4.1Quantitative analysis
- 4.1.1Keyword analysis
- 4.1.1.1Keywords top 10
- 4.1.1.2Keywords top 100
- 4.1.1.3Keywords top 1,000
- 4.1.1.4Keywords top 2,000
- 4.1.2Word combinations
- 4.1.3Hate speech
- 4.1.1Keyword analysis
- 4.2Qualitative analysis
- 4.2.1Homophobia
- 4.2.2Racism
- 4.2.3Misogyny
- 4.2.4Anti-feminism
- 4.1Quantitative analysis
- 5.Text profiling
- 5.1Quantitative Analysis
- Sentiment Analysis
- Demographic Profiling
- 5.1.1Psychological profiling
- 5.2Qualitative analysis
- 5.2.1Demographic profiling
- Gender
- Age
- Race
- 5.2.2Physical profiling
- 5.2.3Psychological profiling
- Isolation
- Inhibition
- Negativity
- Neglect
- 5.2.4Profile summary
- 5.2.1Demographic profiling
- 5.1Quantitative Analysis
- 6.Relation to violent extremism
- 6.1Group dynamics
- 6.1.1Incitement to violence
- 6.1.2Threatening
- 6.1.3Automatic detection
- 6.1Group dynamics
- 7.Conclusion
- Acknowledgements
- Notes
References
References (49)
Argamon, Shlomo, Moshe Koppel, James W. Pennebaker, and Jonathan Schler. 2009. “Automatically Profiling the Author of an Anonymous Text.” Communications of the ACM 52(2):119–23.
Berger, J. M. 2017. “Extremist Construction of Identity: How Escalating Demands for Legitimacy Shape and Define In-Group and Out-Group Dynamics.” ICCT Research Paper. [URL].
Blommaert, Jan. 2017. “Online-offline Modes of Identity and Community: Elliot Rodger’s Twisted World of Masculine Victimhood.” Tilburg Papers in Culture Studies 2001. [URL]
Bou-Franch, Patricia, and Pilar Garcés-Conejos Blitvich. 2016. “Gender Ideology and Social Identity Processes in Online Language Aggression against Women.” In Exploring Language Aggression against Women, edited by Patricia Bou-Franch, 59–81. Amsterdam/Philadelphia: John Benjamins.
Brennan, Michael, Zadia Afroz, and Rachel Greenstadt. 2012. “Adversarial Stylometry: Circumventing Authorship Recognition to Preserve Privacy and Anonymity.” ACM Transactions on Information and System Security 15(3): Art. 12.
Brown, Alexander. 2017. “What is Hate Speech? Part 1: The Myth of Hate.” Law and Philosophy 361: 419–468.
Brown, Rachel. 2016. Defusing Hate: A Strategic Communication Guide to Counteract Dangerous Speech. [URL]
Brown, Rupert, and Hanna Zagefka. 2005. “Ingroup Affiliations and Prejudice.” In On the Nature of Prejudice, edited by John F. Dovidio, Peter Glick, and Laurie A. Rudman, 54–70. Maldon, MA, etc.: Blackwell.
Chollet, François. 2015. Keras: Deep Learning Library for Theano and Tensorflow. [URL]
Colleoni, Elanor, Alessandro Rozza, and Adam Arvidsson. 2014. “Echo Chamber or Public Sphere? Predicting Political Orientation and Measuring Political Homophily in Twitter Using Big Data.” Journal of Communication 64(2):317–32.
Collins, Michael. 2002. “Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms.” Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing 101: 1–8.
De Smedt, Tom, and Walter Daelemans. 2012. “Pattern for Python.” Journal of Machine Learning Research 131: 2063–2067. [URL]
De Smedt, Tom, Guy De Pauw, and Pieter Van Ostaeyen. 2018. “Automatic Detection of Online Jihadist Hate Speech.” CLiPS Technical Report Series 71: 1–30. [URL]
Dholakia, Utpal M., and Richard P. Bagozzi. 2004. “Motivational Antecedents, Constituents and Consequents of Virtual Community Identity.” In Virtual and Collaborative Teams: Process, Technologies, and Practice, edited by Susan H. Godar and Sharmila P. Ferris, 252–67. Hershey/London: Idea Group Publishing.
DiMauro, Dina. 2008. “Reluctant Virginity: The Relationship between Sexual Status and Self-esteem.” Theses and Dissertations 7171. [URL]
Donnelly, Denise, Elisabeth Burgess, Sally Anderson, Regina Davis, and Joy Dillard. 2001. “Involuntary Celibacy: A Life Course Analysis.” The Journal of Sex Research 38(2):159–69.
Douglas, Karen M. 2009. “Psychology, Discrimination and Hate Groups Online.” In The Oxford Handbook of Internet Psychology, edited by Adam N. Joinson, Katelyn Y. A. McKenna, Tom Postmes, and Ulf-Dietrich Reips, 155–63. Oxford/New York: Oxford University Press.
Ging, Debbie. 2017. “Alphas, Betas, and Incels: Theorizing the Masculinities of the Manosphere.” Men and Masculinities.
Haines, Russel, Jill Hough, Lan Cao, and Douglas Haines. 2014. “Anonymity in Computer-mediated Communication: More Contrarian Ideas with Less Influence.” Group Decision and Negotiation 23(4):765–86.
Hamm, Mark S., and Ramón F. J. Spaij. 2017. The Age of Lone Wolf Terrorism. New York/Chichester: Columbia University Press.
Haythornthwaite, Caroline. 2009. “Social Networks and Online Community.” In The Oxford Handbook of Internet Psychology, edited by Adam N. Joinson, Katelyn Y. A. McKenna, Tom Postmes, and Ulf-Dietrich Reips, 121–137. Oxford/New York: Oxford University Press.
Jane, Emma A. 2014a. “Back to the Kitchen, cunt”: Speaking the Unspeakable about Online Misogyny. Continuum: Journal of Media and Cultural Studies 28(4):558–70.
2017. “Systemic Misogyny Exposed: Translating Rapeglish from the Manosphere with a Random Rape Threat Generator.” International Journal of Cultural Studies 21(6):661–80.
Kim, Yoon. 2014. “Convolutional Neural Networks for Sentence Classification.” arXiv: 1408.5882, [URL]
Kleinke, Sonja, and Birte Bös. 2015. “Intergroup Rudeness and the Metapragmatics of its Negotiation in Online Discussion Fora.” Pragmatics 25(1):47–71.
Langman, Peter. 2016. “Elliot Rodger: An Analysis.” [URL]
Larkin, Ralph W. 2018. “Learning to be a Rampage Shooter: The Case of Elliot Rodger.” In The Wiley Handbook on Violence in Education: Forms, Factors, and Preventions, edited by Harvey Shapiro, 69–84. Hoboken, NJ: Wiley & Sons.
Mantilla, Karla. 2013. “Gendertrolling: Misogyny Adapts to New Media.” Feminist Studies 39(2):563–70. [URL]
Marx, Konstanze. 2018. “Cybermobbing aus sprachwissenschaftlicher Perspektive.” Sprachreport 1/18: 1–9. [URL]
Musolff, Andreas. 2012. “The Study of Metaphor as Part of Critical Discourse Analysis.” Critical Discourse Studies 9(3):301–10.
Newman, Matthew L., Carla J. Groom, Lori D. Handelman, and James W. Pennebaker. 2008. “Gender Differences in Language Use: An Analysis of 14,000 Text Samples.” Discourse Processes 451: 211–36.
Neuman, Yair, Dan Assaf, Yochai Cohen, and James L. Knoll. 2015. “Profiling School Shooters: Automatic Text-based Analysis.” Frontiers in Psychiatry 61: Art. 86.
Nockleby, John T. 2000. “Hate Speech.” In Encyclopedia of the American Constitution. Vol. 31, 2nd ed., edited by Leonard W. Levy and Kenneth L. Karst, 1277–1279. Detroit: Macmillan Reference US.
Pennebaker, James W. 2011. The Secret Life of Pronouns. What our Words Say about us. New York: Bloomsbury.
Pennebaker, James W., Martha E. Francis, and Roger J. Booth. 2001. Linguistic Inquiry and Word Count: LIWC 2001. Mahwah, NJ: Lawrence Erlbaum Associates.
Plummer, Ken. 2005. “Male Sexualities.” In Handbook of Studies on Men & Masculinities, edited by Michael S. Kimmel, Jeff Hearn, and R. W. Connell, 178–195. Thousand Oaks/London/New Delhi: Sage.
Rego, Richard. 2018. “Changing Forms and Platforms of Misogyny: Sexual Harassment of Women Journalists on Twitter.” Media Watch 9(3):472–485.
Salter, Anastasia, and Bridget Blodgett. 2012. “Hypermasculinity & Dickwolves: The Contentious Role of Women in the New Gaming Public.” Journal of Broadcasting & Electronic Media 56(3):401–16.
Schmidt, Anna, and Michael Wiegand. 2017. “A Survey on Hate Speech Detection Using Natural Language Processing.” Proceedings of the Fifth Workshop on Natural Language Processing for Social Media: 1–10.
Turnage, Anna K. 2007. “Email Flaming Behaviors and Organizational Conflict.” Computer-Mediated Communication 13(1):43–59.
Van Valkenburgh, Shawn P. 2018. “Digesting the Red Pill: Masculinity and Neoliberalism in the Manosphere.” Men and Masculinities.
Zimmerman, Shannon, Luisa Ryan, and David Duriesmith. 2018. “Recognizing the Violent Extremist Ideology of ‘Incels’.” Women in International Security policybrief 09/2018: 1–5. [URL]
Cited by (146)
Cited by 146 other publications
Abdellaoui, Abdel, Laura W. Wesseldijk, Scott D. Gordon, Joëlle A. Pasman, Dirk J. A. Smit, Renáta Androvičová, Nicholas G. Martin, Fredrik Ullén, Miriam A. Mosing, Brendan P. Zietsch & Karin J. H. Verweij
Adams, Nicholas Norman & David S. Smith
Beckett‐Herbert, AnnaRose & Eran Shor
Berškytė, Justina & Mihaela Popa-Wyatt
Chen, Melissa
Close, Henry S. G., Lewis Nitschinsk, Brendan P. Zietsch & Fiona Kate Barlow
Costello, William
Costello, William, Joe Whittaker & Andrew G. Thomas
Coufal, Linda, Tuija Saresma & Heidi Kosonen
Coufal, Linda & Lion Wedel
Di Cicco, Gabriele, Federico Contu, Laura Prislei, Michele J. Gelfand, Arie W. Kruglanski & Erica Molinario
Dunning, Michael, Matthew Hart & Georgia Marfoh-Hoare
Green, Robert, Kurt Fowler & Allan Palombi
Halpin, Michael, Norann Richard, Kayla Preston, Meghan Gosse & Finlay Maguire
Herissone-Kelly, Robert, Miriam Ronzoni, Mihaela Popa-Wyatt, Ajinkya Deshmukh, Justina Berškytė & Thomas Chadwick
Jin, Ruining & Xiao Wang
López-Rodríguez, Irene
McNicholas, Fiona & Gordon Harold
Naegler, Laura, Gabe Mythen & Jacob Astley
Papandreou, Chloe, Brandon Sparks, Sarah Daly & Emily M. Pacheco
Pettersson, Katarina, Mark Daniel Marveggio, Peta Callaghan & Martha Augoustinos
Piazza, James A.
Popa‐Wyatt, Mihaela & Justina Berškytė
Preston, Kayla, Michael Halpin & Demeter Lockyer
Rajan, Benson
Rodríguez, Reyes, Miguel A. Maldonado & Manuel Moyano
Schneevogt, Daniela & Emily Chiang
Serafis, Dimitris & Janina Wildfeuer
Setty, Emily
Solopova, Veronika, Mihaela Popa-Wyatt & Justina Berškytė
Wilén, Evelina Johansson
Aiolfi, Irene, Nicola Palena, Caoilte Ó Ciardha & Letizia Caso
Bachaud, Louis
Bendfeldt, Luise
Beringuy, Adriano & Leandro Guimarães Marques Alvim
Burns, Léa-May & Marie-Aude Boislard
Copeland, Olivia M.
Costello, William, Vania Rolon, Andrew G. Thomas & David P. Schmitt
Czerwinsky, Allysa
Daly, Sarah E. & Annie Laurie Nichols
de Roos, Melissa S., Laura Veldhuizen-Ochodničanová & Alexis Hanna
Deng, Yue, Zheng Chen, Changyang He, Zhicong Lu & Bo Li
Evans, Hannah Rae & Adam Lankford
Graso, Maja & Tania Reynolds
Halpin, Michael, Kayla Preston, Demeter Lockyer & Finlay Maguire
Helm, Brenna, Thomas J. Holt, Ryan Scrivens, Thomas W. Wojciechowski & Richard Frank
Helm, Brenna, Ryan Scrivens, Thomas J. Holt, Steve Chermak & Richard Frank
Hidalgo-Downing, Laura, Paula Pérez-Sobrino, Laura Filardo-Llamas, Carmen Maíz-Arévalo, Begoña Núñez-Perucha, Alfonso Sánchez-Moya & Julia T. Williams Camus
2024. A protocol for the annotation of evaluative stance and metaphor across four discourse genres. Revista Española de Lingüística Aplicada/Spanish Journal of Applied Linguistics 37:2 ► pp. 486 ff.
Janssen, Mathieu, Claudia Zucca, Giuseppe Cascavilla & Alfredo Cuzzocrea
Jensen, Kim Ebensgaard
Lankford, Adam & Jason R. Silva
Laplante, Sabrina, Andrée-Ann Labranche & Marie Aude Boislard
Leite-Mendonca, Sabrina & Marie-Aude Boislard
Lucas, Ashrah, François Poulin & Marie-Aude Boislard
Lucy, Stu
Matter, Daniel, Miriam Schirmer, Nir Grinberg & Jürgen Pfeffer
Osuna, Amanda Isabel
O’Hanlon, Robin, Frederick L. Altice, Roy Ka-Wei Lee, Jack LaViolette, Gloria Mark, Orestis Papakyriakopoulos, Koustuv Saha, Munmun De Choudhury & Navin Kumar
Palomino Manjón, Patricia
Palomino-Manjón, Patricia
Petreca, Victor G., Alexandra A. Burgess, Joanne T. Barros, Jennifer Wise & Ann W. Burgess
Pfundmair, Michaela, Natasha R. Wood, Andrew Hales & Eric D. Wesselmann
Price, Henry
Rothermel, Ann-Kathrin & Megan Kelly
Rousis, Gregory J., Francois Alexi Martel, Jennifer K. Bosson & William B. Swann
Scaffidi Abbate, Costanza, Federica Rapacciuolo & Silvana Miceli
West, J. J
Aiston, Jessica
Alduais, Ahmed, Mohammed Ali Al-Khulaidi, Silvia Allegretta & Mona Mohammed Abdulkhalek
Andersen, Jan Christoffer
Androutsopoulos, Jannis
Androutsopoulos, Jannis
Baele, Stephane J., Lewys Brace & Travis G. Coan
Bogetić, Ksenija, Frazer Heritage, Veronika Koller & Mark McGlashan
Broyd, Josephine, Lauren Boniface, Damon Parsons, David Murphy & Jonathan D Hafferty
Chan, Esli
Chan, Esli
Dickel, Valerie & Giulia Evolvi
Han, Xiaoting & Chenjun Yin
Heritage, Frazer
Heritage, Frazer
Jaki, Sylvia
Lindner, Miriam
Ophir, Yotam, Meredith L. Pruden, Dror Walter, Ayse D. Lokmanoglu, Catherine Tebaldi & Rui Wang
O’Malley, Roberta Liggett & Brenna Helm
Proust, Valentina & Magdalena Saldaña
Shrestha, Amendra, Lisa Kaati & Nazar Akrami
Solea, Anda Iulia & Lisa Sugiura
Stijelja, Stefan & Brian L. Mishara
Tastenhoye, Camille A., Juliette Dupré, Nina E. Ross, Tanya V. Bodnar & Susan Hatters Friedman
Thorburn, Joshua, Anastasia Powell & Peter Chambers
Zhou, Linda, Andrew Caines, Ildiko Pete & Alice Hutchings
Atari, Mohammad, Aida Mostafazadeh Davani, Drew Kogon, Brendan Kennedy, Nripsuta Ani Saxena, Ian Anderson & Morteza Dehghani
Bosson, Jennifer K., Gregory J. Rousis & Roxanne N. Felig
Carian, Emily
Chang, Winnie
Costello, William, Vania Rolon, Andrew G. Thomas & David Schmitt
DeCook, Julia R. & Megan Kelly
Fowler, Kurt
Grunau, Karolin, Helena E. Bieselt, Pelin Gul & Tom R. Kupfer
Habib, Hussam, Padmini Srinivasan & Rishab Nithyanand
Horten, Barbara & Marleen Orth
Iveson, Mandie & Federica Formato
Menzie, Lauren
Modha, Sandip, Prasenjit Majumder & Thomas Mandl
O'Donnell, Catharina & Eran Shor
Prøitz, Lin, Fredrik Langeland, Kamilla Knutsen Steinnes & Henry Mainsah
Rajesh, E., Shajahan Basheer, Rajesh Kumar Dhanaraj, Soni Yadav, Seifedine Kadry, Muhammad Attique Khan, Ye Jin Kim & Jae-Hyuk Cha
Sabry, Sana Sabah, Tosin Adewumi, Nosheen Abid, Gyorgy Kovacs, Foteini Liwicki & Marcus Liwicki
Sparks, Brandon, Alexandra M. Zidenberg & Mark E. Olver
Sparks, Brandon, Alexandra M. Zidenberg & Mark E. Olver
Sparks, Brandon, Alexandra M. Zidenberg & Mark E. Olver
Trott, Verity Anne
Becksmann, Jakob
Fahd, Ryan Muhammad & Akbar Mohammad Arief
Hajarian, Mohammad & Zahra Khanbabaloo
Kerr, Selina E.M.
Kerr, Selina E.M.
Pelzer, Björn, Lisa Kaati, Katie Cohen & Johan Fernquist
Preston, Kayla, Michael Halpin & Finlay Maguire
Saragoza, Philip A., Stephen G. White & Victor Hong
Schwartz, Martin D.
Sear, Rebecca
Sugiura, Lisa
Tranchese, Alessia & Lisa Sugiura
van der Vegt, Isabelle, Maximilian Mozes, Bennett Kleinberg & Paul Gill
Williams, D. J., Michael Arntfield, Kaleigh Schaal & Jolene Vincent
Dynel, Marta
Dynel, Marta & Fabio I. M. Poppi
Gill, Paul, Zoe Marchment, Sanaz Zolghadriha, Nadine Salman, Bettina Rottweiler, Caitlin Clemmow & Isabelle Van Der Vegt
Heritage, Frazer & Veronika Koller
Jones, Callum, Verity Trott & Scott Wright
Modha, Sandip, Prasenjit Majumder, Thomas Mandl & Chintak Mandalia
Mussiraliyeva, Shynar, Milana Bolatbek, Batyrkhan Omarov, Zhanar Medetbek, Gulshat Baispay & Ruslan Ospanov
Prażmo, Ewelina
Prażmo, Ewelina
2022. In dialogue with non-humans or how women are silenced in incels’ discourse. Language and Dialogue 12:3 ► pp. 383 ff.
Prażmo, Ewelina
Witt, Taisto
[no author supplied]
This list is based on CrossRef data as of 13 november 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.
