Cover not available

Article published In: Concepts and Context in Relevance-Theoretic Pragmatics: New Developments
Edited by Agnieszka Piskorska and Manuel Padilla Cruz
[Pragmatics 33:3] 2023
► pp. 393–417

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
EPUB logo with download linkDownload EPUB

Perceptual resemblance and the communication of emotion in digital contexts

A case of emoji and reaction GIFs

ORCiD logo with link | Dublin City University
Open Access logo
Available under the Creative Commons Attribution-NonCommercial (CC BY-NC) 4.0 license.
Published online: 1 August 2022
DOI logo with link
https://doi.org/10.1075/prag.21058.sas
Abstract
Online communication has created new ways to express emotions, including emoji and reaction GIFs. Emoji are often discussed as signs for meaning-making, adding emotional tone to communication. Reaction GIFs express emotions and attitudes in a playful manner. This study shows that through the lens of cognitive pragmatics, these phenomena are not distinct. Both are cases of non-verbal communication pointing to the communicator’s emotional state. Drawing on relevance-theoretic notions of the showing-meaning continuum and perceptual resemblance, along with relevance-theoretic analyses of metaphor and irony, I argue that emoji and reaction GIFs provide clues to ostension and communicate emotions by virtue of perceptual resemblance between what they represent and the communicator’s emotional state. I will also argue that both emoji and GIFs can involve echoic use of language, enabling the communicator to convey their attitude.
Article outline
  • 1.Introduction
  • 2.Previous studies
    • 2.1The semantics and pragmatics of emoji
    • 2.2A relevance-theoretic account of emoji
    • 2.3Reaction GIFs
  • 3.Relevance theory
  • 4.Emoji, GIFs, and relevance
  • 5.Conclusion
  • Notes
  • Bibliography
References (62)
Bibliography
Aldredge, Jourdan. 2019. “The Michael Jackson Popcorn Gif and the Controversy of ‘Leaving Neverland’.” No Film School. Available at [URL]. Accessed 15 October 2020.
Ash, James, and Stephen Wilhite. 2015. “Sensation, Networks, and the GIF: Toward an Allotropic Account of Affect.” In Networked Affect, ed. by Ken Hillis, Susanna Paasonen, and Michael Petit, 119–133. Cambridge, MA: MIT Press. Google Scholar logo with link to Google Scholar
Bai, Qiyu, Qi Dan, Zhe Mu, and Maokun Yang. 2019. “A Systematic Review of Emoji: Current Research and Future Perspectives.” Frontiers in Psychology 101: 2221. Google Scholar logo with link to Google Scholar
Carston, Robyn. 1997. “Enrichment and Loosening: Complementary Processes in Deriving the Proposition Expressed?” Linguistische Berichte 81, Special Issue on Pragmatics: 103–127. Google Scholar logo with link to Google Scholar
. 1999. “The Semantics/Pragmatics Distinction: A View from Relevance Theory.” In The Semantics/Pragmatics Interface from Different Points of View, ed. by Ken Turner, 85–125. Amsterdam: Elsevier.Google Scholar logo with link to Google Scholar
. 2002. Thoughts and Utterances. Oxford: Blackwell. Google Scholar logo with link to Google Scholar
. 2004. “Explicature and Semantics.” In Semantics: A Reader, ed. by S. Davis, and B. Gillon, 1–44. Oxford: Oxford University Press.Google Scholar logo with link to Google Scholar
. 2008. “Linguistic Communication and the Semantics/Pragmatics Distinctions.” Synthèse 165 (3): 321–345. Google Scholar logo with link to Google Scholar
. 2010. “Metaphor: Ad Hoc Concepts, Literal Meaning and Mental Images.” Proceedings of the Aristotelian Society 110 (3): 295–321. Google Scholar logo with link to Google Scholar
Cheng, Lifen. 2017. “Do I Mean What I Say and Say What I Mean? A Cross-Cultural Approach to the Use of Emoticons & Emojis in CMC Messages.” FONSECA: Journal of Communication 151: 199–217. Google Scholar logo with link to Google Scholar
Cho, Alexander. 2015. “Queer Reverb: Tumblr, Affect, Time.” In Networked Affect, ed. by Ken Hillis, Susanna Paasonen, and Michael Petit, 43–58. Cambridge, MA: MIT Press. Google Scholar logo with link to Google Scholar
Collister, Lauren. 2015. “Textspeak is Modernizing the English Language.” New Republic. [URL]
Danesi, Marcel. 2017. The Semiotics of Emoji: The Rise of Visual Language in the Age of the Internet. London: Bloomsbury. Google Scholar logo with link to Google Scholar
Eppink, Jason. 2014. “A Brief History of the Gif (So Far).” Journal of Visual Culture 131: 298–306. Google Scholar logo with link to Google Scholar
Fauconnier, Gilles. 1997. Mappings in Thought and Language. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Forceville, Charles. 2020. Visual and Multimodal Communication: Applying the Relevance Principle. Oxford: Oxford University Press. Google Scholar logo with link to Google Scholar
Gibson, Will, Pingping Huang, and Qianyun Yu. 2018. “Emoji and Communicative Action: The Semiotics, Sequence and Gestural Actions of ‘Face Covering Hand’.” Discourse, Context & Media 261: 91–99. Google Scholar logo with link to Google Scholar
Gülşen, Tüge. T. 2016. “You Tell Me in Emojis.” In Computational and Cognitive Approaches to Narratology, ed. by T. Ogata and T. Akimoto, 354–375. IGI Global. Google Scholar logo with link to Google Scholar
Hall, Jeffrey. A., and Natalie Pennington. 2013. “Self-Monitoring, Honesty, and Cue Use on Facebook: The Relationship with User Extraversion and Conscientiousness.” Computers in Human Behavior 291: 1556–1564. Google Scholar logo with link to Google Scholar
Hjartstrom, Hanna, Daniel E. Sörman, and Jessica K. Ljungberg. 2019. “Distraction and Facilitation: The Impact of Emotional Sounds in an Emoji Oddball Task.” PsyCh Journal 81: 180–186. Google Scholar logo with link to Google Scholar
Hymes, Dell. 1971. On Communicative Competence. Philadelphia: University of Pennsylvania Press.Google Scholar logo with link to Google Scholar
Jaeger, Sara R., and Gastón Ares. 2017. “Dominant Meanings of Facial Emoji: Insights from Chinese Consumers and Comparison with Meanings from Internet Resources.” Food Quality and Preference 621: 275–283. Google Scholar logo with link to Google Scholar
Jaeger, Sara R., Christina M. Roigard, David Jin, Leticia Vidal, and Gastón Ares. 2019. “Valence, Arousal and Sentiment Meanings of 33 Facial Emoji: Insights for the Use of Emoji in Consumer Research.” Food Research International. 1191: 895–907. Google Scholar logo with link to Google Scholar
Jakobson, Roman. 1960. “Linguistics and Poetics.” In Style in Language, ed. by Thomas A. Sebeok, 34–45. Cambridge, MA: MIT Press.Google Scholar logo with link to Google Scholar
Jibril, Ahmed Tanimu, and Mardziah Haytati Abdullah. 2013. “Relevance of Emoticons in Computer-Mediated Communication Contexts: An Overview.” Asian Social Science 91: 201. Google Scholar logo with link to Google Scholar
Katz, Yuval, and Limor Shifman. 2017. “Making Sense? The Structure and Meanings Of Digital Memetic Nonsense.” Information, Communication & Society 201: 825–842. Google Scholar logo with link to Google Scholar
Lakoff, George. 1987. Women, Fire and Dangerous Things: What Categories Reveal about the Mind. Chicago, IL: University of Chicago Press. Google Scholar logo with link to Google Scholar
. 1994. “What is Metaphor?” Advances in Connectionist and Neural Computation Theory 31: 203–258.Google Scholar logo with link to Google Scholar
López, Rebecca Padilla, and Fabienne Cap. 2017. “Did You Ever Read about Frogs Drinking Coffee? Investigating the Compositionality of Multi-Emoji Expressions.” Paper Presented at the 8th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis.
Miltner, Kate M., and Tim Highfield. 2017. “Never Gonna GIF You Up: Analyzing the Cultural Significance of the Animated GIF.” Social Media and Society 3.31: 1–11. Google Scholar logo with link to Google Scholar
Paasonen, Susanna, Ken Hillis, and Michael Petit. 2015. “Introduction: Networks of Transmission: Intensity, Sensation, Value.” In Networked affect, ed. by Ken Hillis, Susanna Paasonen, and Michael Petit, 1–24. Cambridge: The MIT Press. Google Scholar logo with link to Google Scholar
Prada, Marília, David L. Rodrigues, Margarida V. Garrido, Diniz Lopes, Bernardo Cavalheiro, and Rui Gaspar. 2018. “Motives, Frequency and Attitudes toward Emoji and Emoticon Use.” Telematics and Informatics 351: 1925–1934. Google Scholar logo with link to Google Scholar
Riordan, Monica A. 2017. “Emojis as Tools for Emotion Work: Communicating Affect in Text Messages.” Journal of Language and Social Psychology 361: 549–567. Google Scholar logo with link to Google Scholar
Sadiq, M., and Shahida. 2019. “Learning Pakistani Culture through the Namaz Emoji.” 2nd International Conference on Computing, Mathematics and Engineering Technologies (iCoMET): 1–8, Google Scholar logo with link to Google Scholar
Sasamoto, Ryoko and Rebecca Jackson. 2016. “Onomatopoeia – Showing-Word or Saying-Word? Relevance Theory, Lexis, and the Communication of Impressions.” Lingua 1751: 36–53. Google Scholar logo with link to Google Scholar
Sasamoto, Ryoko. 2019. Onomatopoeia and Relevance Communication of Impressions via Sound. London: Palgrave MacMillan. Google Scholar logo with link to Google Scholar
Scott, Kate. 2017. “Prosody, Procedures and Pragmatics.” In Semantics and Pragmatics: Drawing a Line, ed. by I. Depraetere, and R. Salkie, 323–341. Berlin: Springer. Google Scholar logo with link to Google Scholar
. 2022. Pragmatics Online. London: Routledge. Google Scholar logo with link to Google Scholar
Settanni, Michele, and Davide Marengo. 2015. “Sharing Feelings Online: Studying Emotional Well-Being Via Automated Text Analysis of Facebook Posts.” Frontiers in Psychology 61: 1045. Google Scholar logo with link to Google Scholar
Sha. 2016. “The Digital Materiality Of Gifs.” Retrieved from [URL]
Sperber, Dan, and Deirdre Wilson. 1986/1995. Relevance: Communication and Cognition, 2nd ed. Oxford: Blackwell.Google Scholar logo with link to Google Scholar
. 1987. “Précis of Relevance: Communication and Cognition.” Behavioral and Brain Sciences 101: 697–754. Google Scholar logo with link to Google Scholar
. 1998. “Irony and Relevance: A Reply to Seto, Hamamoto and Yamanashi.” In Relevance Theory. Applications and Implications. ed. by R. Carston, and S. Uchida, 283–293. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
. 2015. “Beyond Speaker’s Meaning.” Croatian Journal of Philosophy 15 (2): 117–149.Google Scholar logo with link to Google Scholar
. 2008. “A Deflationary Account of Metaphors.” In The Cambridge Handbook of Metaphor and Thought. ed. by Raymond W. Gibbs, jr., 84–105. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Sujay, Khandekar, Chae Won Ryu, Joseph Higgs, Jerry O. Talton, Yuanzhe Bian, and Ranjitha Kumar. 2019. “Opico: A Study of Emoji-First Communication in a Mobile Social App.” Paper presented at the Companion of the World Wide Web Conference.
Talmy, Leonard. 2000. Toward a Cognitive Semantics, Vol. 21. Cambridge, MA: MIT Press.Google Scholar logo with link to Google Scholar
Tolins, Jackson, and Patrawat Samermit. 2016. “Gifs as Embodied Enactments in Text-Mediated Conversation.” Research on Language and Social Interaction 491: 75–91. Google Scholar logo with link to Google Scholar
Tossell, Chad C., Philip Kortum, Clayton Shepard, Laura H. Barg-Walkow, Ahmad Rahmati, and Lin Zhong. 2012. “A Longitudinal Study of Emoticon Use in Text Messaging from Smartphones.” Computer in Human Behavior 281: 659–663. Google Scholar logo with link to Google Scholar
Veszelszki, Agnes. 2015. “Emoticons vs. Reaction-Gifs. Non-Verbal Communication on the Internet from the Aspects of Visuality, Verbality and Time.” In Beyond Words. Pictures, Parables, Paradoxes, Visual Learning series, vol. 5, ed. by András Benedek, and Kristóf Nyíri, 131–145. Frankfurt: Peter Lang.Google Scholar logo with link to Google Scholar
Wharton, Tim. 2008. “‘Meaning’ and ‘Showing’: Gricean Intentions and Relevance-Theoretic Intentions.” Intercultural Pragmatics 5 (2): 131–152. Google Scholar logo with link to Google Scholar
Wharton, Tin. 2009. Pragmatics and Non-Verbal Communication. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Wilson, Deirdre, and Dan Sperber. 1992. “On Verbal Irony.” Lingua 871: 53–76. Google Scholar logo with link to Google Scholar
. 2002. “Truthfulness and Relevance.” Mind 111 (443): 583–632. Google Scholar logo with link to Google Scholar
. 2004. “Relevance Theory.” In The Handbook of Pragmatics, ed. by Laurence R. Horn, and Gregory Ward, 607–632. Oxford: Blackwell.Google Scholar logo with link to Google Scholar
. 2012. Relevance and Meaning. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Wilson, Deirdre, and Robyn Carston. 2006. “Metaphor, Relevance and the ‘Emergent Property’ Issue.” Mind & Language 21 (3): 404–433. Google Scholar logo with link to Google Scholar
Wilson, Deirdre. 2006. “The Pragmatics of Verbal Irony: Echo or Pretence?” Lingua 1161: 1722–1743. Google Scholar logo with link to Google Scholar
. 2012. Metarepresentation in linguistic communication. In Meaning and Relevance, Deidre Wilson, and Dan Sperber, 230–258. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
. 2021. “Explaining Metonymy.” Paper presented at Institute of Humanities Research Seminar, Northumbria University, 17 March 2021.
Yus, Francisco. 2019. “Emoji: A Full Cyberpragmatic Approach.” Paper presented at the 16th China Pragmatics Conference. Nanchang, China.
. 2021. Smartphone Communication: Interactions in the App Ecosystem. London: Routledge. Google Scholar logo with link to Google Scholar
Cited by (9)

Cited by nine other publications

Dainas, Ashley R.
2025. Lightening the mood with visual humor. Internet Pragmatics 8:2 ► pp. 295 ff. DOI logo
Lübke, Mailyn
2025. Empatía en las lenguas románicas: análisis contrastivo e intrarrománico de comentarios en las redes sociales. In Text, Diskurs, Pragmatik kontrastiv [InnTraRom. Beiträge zu Sprache, Kultur und Translation, 3], ► pp. 97 ff. DOI logo
Murillo, Silvia
2025. The use of emojis in X/Twitter for research recontextualization. Discourse, Context & Media 68 ► pp. 100950 ff. DOI logo
Sampietro, Agnese & Carmen Pérez-Sabater
2025. Pragmatic approaches to visual discourses in digital interactions. Internet Pragmatics 8:2 ► pp. 141 ff. DOI logo
Tariq, Muhammad Usman
2025. Emojis and Emoticons. In Sociocultural and Multicultural Meanings in Online Communication, ► pp. 23 ff. DOI logo
Tong, Ying & Chaoqun Xie
2025. Beyond bonding icons: memes in interactional sequences in digital communities of practice. Multimodal Communication 14:2 ► pp. 237 ff. DOI logo
Yus, Francisco
2025. Pragmatics of Verbal Content vs. Pragmatics of Emoji. In Emoji Pragmatics, ► pp. 127 ff. DOI logo
Yus, Francisco
2025. Inferring from Emojis: From Propositions to Feelings and Emotions. In Emoji Pragmatics, ► pp. 173 ff. DOI logo
Genç, Çağlar, Velvet Spors, Oğuz 'Oz' Buruk, Mattia Thibault, Leland Masek & Juho Hamari
2024. Transhuman Communication: Human Augmentation Technologies through Co-Speculation Workshops. Proceedings of the ACM on Human-Computer Interaction 8:CSCW2 ► pp. 1 ff. DOI logo

This list is based on CrossRef data as of 30 november 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue