Cover not available

Introduction published In: Beyond Words: Pragmatic approaches to visual discourses in digital interactions
Edited by Agnese Sampietro and Carmen Pérez-Sabater
[Internet Pragmatics 8:2] 2025
► pp. 141–151

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
EPUB logo with download linkDownload EPUB
Introduction

Pragmatic approaches to visual discourses in digital interactions

 | Universitat Jaume I
 | Universitat Politècnica de València
Open Access logo
Available under the Creative Commons Attribution (CC BY) 4.0 license.

For any use beyond this license, please contact the publisher at rights@benjamins.nl.

Open Access publication of this article was funded through a Transformative Agreement with Universitat Jaume I.

Published online: 3 June 2025
DOI logo with link
https://doi.org/10.1075/ip.00122.sam
Article outline
  • 1.Visual discourses in digital interaction
  • 2.Overview of the Special Issue
  • Acknowledgements
  • References
References (60)
References
Adami, Elisabetta. 2015. “What’s in a click? A social semiotic framework for the multimodal analysis of website interactivity.” Visual Communication 1421: 133–153. Google Scholar logo with link to Google Scholar
Al Rashdi, Fathiya. 2018. “Functions of emojis in WhatsApp interaction among Omanis.” Discourse, Context & Media 261: 117–126. Google Scholar logo with link to Google Scholar
Albert, Georg. 2020. “Beyond the binary: Emoji as a challenge to the image-word distinction.” In Visualizing Digital Discourse: Interactional, Institutional and Ideological Perspectives, ed. by Crispin Thurlow, Christa Dürscheid, and Francesca Diémoz, 65–80. Belin: De Gruyter Mouton. Google Scholar logo with link to Google Scholar
Bateman, John A. 2014. Text and Image: A Critical Introduction to the Visual/Verbal Divide. Abingdon: Routledge. Google Scholar logo with link to Google Scholar
2016. “Methodological and theoretical issues in multimodality.” In Handbuch Sprache im multimodalen Kontext [Handbook of Language in Multimodal Contexts], ed. by Nina-Maria Klug, and Hartmut Stöckl, 36–74. Berlin: De Gruyter. Google Scholar logo with link to Google Scholar
2017. “Triangulating transmediality: A multimodal semiotic framework relating media, modes and genres.” Discourse, Context & Media 201: 160–174. Google Scholar logo with link to Google Scholar
Beißwenger, Michael, and Steffen Pappert. 2019. “How to be polite with emojis: A pragmatic analysis of face work strategies in an online learning environment.” European Journal of Applied Linguistics 7(2): 225–254. Google Scholar logo with link to Google Scholar
Cantamutto, Lucía Marina, and Cristina Vela Delfa. 2019. “Emojis frecuentes en las interacciones por Whatsapp: Estudio comparativo entre dos variedades de español (Argentina y España) [Frequent emojis in WhatsApp interactions: A comparative study of two Spanish varieties (Argentina and Spain)].” Círculo de Lingüística Aplicada a la Comunicación 77(3): 171–186. Google Scholar logo with link to Google Scholar
Cohn, Neil, and Joost Schilperoord. 2022. “Reimagining language.” Cognitive Science 46(7), e13174. Google Scholar logo with link to Google Scholar
Dainas, Ashley R. 2023. “The GIF that keeps on giving: Sender and receiver interpretations and misconstruals of GIFs.” PhD dissertation, Indiana University. [URL]
Dainas, Ashley R., and Susan C. Herring. 2021. “Interpreting emoji pragmatics.” In Approaches to Internet Pragmatics: Theory and Practice, ed. by Chaoqun Xie, Francisco Yus, and Hartmut Haberland, 107–144. Amsterdam: John Bernjamns. Google Scholar logo with link to Google Scholar
Djonov, Emilia, and Theo van Leeuwen. 2018. “The power of semiotic software: A critical multimodal perspective.” In The Routledge Handbook of Critical Discourse Analysis, ed. by John Flowerdew, and John E. Richardson, 566–581. Abingdon: Routledge.Google Scholar logo with link to Google Scholar
Dresner, Eli, and Susan C. Herring. 2010. “Functions of the nonverbal in CMC: Emoticons and illocutionary force.” Communication Theory 20(3): 249–268. Google Scholar logo with link to Google Scholar
Elleström, Lars. 2010. “The modalities of media: A model for understanding intermedial relations.” In Media Borders, Multimodality and Intermediality, ed. by Lars Elleström, 11–50. Basingstoke: Palgrave Macmillan. Google Scholar logo with link to Google Scholar
Flores-Salgado, Elizabeth, and Michael Witten. 2023. “Illocutionary context and management allocation of emoji and other graphicons in Mexican parent school WhatsApp communities.” Journal of Pragmatics 2101: 24–35. Google Scholar logo with link to Google Scholar
Ge-Stadnyk, Jing, Susan C. Herring, and Lusha Sa. 2025. “Multimodality in digital discourse: Exploring image-text interrelations in WeChat sticker use.” In Experiencing Digital Discourses: Multimodality, Engagement, Activism, ed. by Camilla Vásquez, and Jan Chovanec. Cham: Palgrave Macmillan. Google Scholar logo with link to Google Scholar
Giles, David, Wyke Stommel, and Trena M. Paulus. 2017. “The microanalysis of online data: The next stage.” Journal of Pragmatics 1151: 37–41. Google Scholar logo with link to Google Scholar
Giles, David, Wyke Stommel, Trena Paulus, Jessica Lester, and Darren Reed. 2015. “Microanalysis of online data: The methodological development of ‘Digital CA’.” Discourse, Context & Media 71: 45–51. Google Scholar logo with link to Google Scholar
Herring, Susan C. 2019. “The co-evolution of computer-mediated communication and computer-mediated discourse Analysis.” In Analysing Digital Discourse: New Insights and Future Directions, ed. by Patricia Bou-Franch, and Pilar Garcés-Conejos Blitvich, 25–67. Cham: Palgrave Macmillan. Google Scholar logo with link to Google Scholar
Herring, Susan C., and Ashley R. Dainas. 2017. “‘Nice picture comment!’: Graphicons in Facebook comment threads.” In Proceedings of the Fiftieth Hawai’i International Conference on System Sciences, 2185–2194. Los Alamitos, CA: IEEE Press. Google Scholar logo with link to Google Scholar
Herring, Susan C., Anupam Das, and Shashikant Penumarthy. 2005. “CMC act taxonomy.” [URL] (accessed 20 March 2023).
Herring, Susan C., and Jing Ge-Stadnyk. 2024. “Emoji and illocutionarity: Acting on, and acting as, language.” In Structures in Discourse: Interaction, Adaptability, and Pragmatic Functionss, ed. by Martin Gill, Aino Malmivirta, and Brita Wårvik, 124–155. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Jewitt, Carey. 2009. “Different approaches to multimodality.” In The Routledge Handbook of Multimodal Analysis, ed. by Carey Jewitt, 28–39. Abingdon: Routledge.Google Scholar logo with link to Google Scholar
Jewitt, Carey, and Berit Henriksen. 2016. “Social semiotic multimodality.” In Handbuch Sprache im multimodalen Kontext [Handbook of Language in Multimodal Contexts], ed. by Nina-Maria Klug, and Hartmut Stöckl, 145–164. Berlin: De Gruyter. Google Scholar logo with link to Google Scholar
Konrad, Artie, Susan C. Herring, and David Choi. 2020. “Sticker and emoji use in Facebook messenger: Implications for graphicon change.” Journal of Computer-Mediated Communication 25(3): 217–235. Google Scholar logo with link to Google Scholar
König, Katharina. 2019. “Stance taking with ‘laugh’ particles and emojis — Sequential and functional patterns of ‘laughter’ in a corpus of German WhatsApp chats.” Journal of Pragmatics 1421: 156–170. Google Scholar logo with link to Google Scholar
. 2024. “Transmodal messenger interaction–Analysing the sequentiality of text and audio postings in WhatsApp chats.” Discourse, Context & Media 621, 100818. Google Scholar logo with link to Google Scholar
Kress, Gunther. 2010. Multimodality: A Social Semiotic Approach to Contemporary Communication. Abingdon: Routledge.Google Scholar logo with link to Google Scholar
Kress, Gunther, and Theo van Leeuwen. 2021. Reading Images: The Grammar of Visual Design (3rd edn.). Abingdon: Routledge.Google Scholar logo with link to Google Scholar
Lim, Victor. 2019. “Investigating intersemiosis: A systemic functional multimodal discourse analysis of the relationship between language and gesture in classroom discourse.” Visual Communication 20(1): 34–58. Google Scholar logo with link to Google Scholar
Linares Bernabéu, Esther, and María Belén Alvarado Ortega. 2025. “Unveiling humour in digital discourse: The pragmatic functions of humorous stickers in Spanish Whatsapp chat groups.” Lodz Papers in Pragmatics 21(1): 55–82. Google Scholar logo with link to Google Scholar
Martinec, Radan. 2013. “Nascent and mature uses of a semiotic system: The case of image–text relations.” Visual Communication 1221: 147–172. Google Scholar logo with link to Google Scholar
Martinec, Radan, and Andrew Salway. 2005. “A system for image–text relations in new and old media.” Visual Communication 431: 337–371. Google Scholar logo with link to Google Scholar
O’Halloran, Kay (ed.). 2004. Multimodal Discourse Analysis: Systemic Functional Perspectives. London: Continuum.Google Scholar logo with link to Google Scholar
O’Halloran, Kay L. 2011. “Multimodal discourse analysis.” In The Bloomsbury Handbook of Discourse Analysis, ed. by Ken Hyland, Brian Paltridge, and Lillian Wong, 249–282. London: Bloomsbury.Google Scholar logo with link to Google Scholar
Padilla, Xose A. 2023. “El código emoji: de la interfaz frecuencia-función a la identidad discursiva digital [Emoji code: From the frequency-function interface to digital discursive identity].” Círculo de Lingüística Aplicada a la Comunicación 931: 243–257. Google Scholar logo with link to Google Scholar
Pérez-Sabater, Carmen. 2019. ‘Emoticons in relational writing practices on WhatsApp: Some reflections on gender.” In Analyzing Digital Discourse: New Insights and Future Directions, ed. by Patricia Bou-Franch, and Pilar Garcés-Conejos Blitvich, 163–189. Cham: Palgrave Macmillan. Google Scholar logo with link to Google Scholar
. 2021. “Moments of sharing, language style and resources for solidarity on social media: A comparative analysis.” Journal of Pragmatics 1801: 266–282. Google Scholar logo with link to Google Scholar
. 2024. La informalización del discurso digital público: Reflexiones sobre el inglés y el español [The Informalization of Public Digital Discourse: Reflections on English and Spanish]. Abingdon: Routledge. Google Scholar logo with link to Google Scholar
Sampietro, Agnese. 2016. “Exploring the punctuating effect of emoji in Spanish Whatsapp chats.” Lenguas Modernas 471: 91–113. [URL] (accessed 20 March 2023).
. 2019. “Emoji and rapport management in Spanish WhatsApp chats.” Journal of Pragmatics 1431: 109–120. Google Scholar logo with link to Google Scholar
. 2023a. “El auge de los stickers en WhatsApp y la evolución de la comunicación digital [The rise of stickers on WhatsApp and the evolution of digital communication].” Círculo de Lingüística Aplicada a la Comunicación 941: 271–285. Google Scholar logo with link to Google Scholar
. 2023b. Lengua e imagen en la comunicación digital [Language and Image in Digital Communication]. Madrid: Arco/Libros.Google Scholar logo with link to Google Scholar
. 2023c. “More than laughter: Multimodal humour and the negotiation of in-group identities in mobile instant messaging interactions.” In Interactional Humor: Multimodal Design and Negotiation, ed. by Béatrice Priego-Valverde, 263–287. Berlin: De Gruyter Mouton. Google Scholar logo with link to Google Scholar
Sampietro, Agnese, Samuel Felder, and Beat Siebenhaar. 2022. “Do you kiss when you leave? Exploring the use of the kissing emojis in three Whatsapp corpora.” Intercultural Pragmatics 19(2): 183–208. Google Scholar logo with link to Google Scholar
Siefkes, Martin. 2015. “How semiotic modes work together in multimodal texts: Defining and representing intermodal relations.” 10plus1: Living Linguistics 11: 112–131.Google Scholar logo with link to Google Scholar
Siever, Christina M., and Torsten S. Siever. 2020. “Emoji-text relations on Instagram: Empirical corpus studies on multimodal uses of the iconographetic mode.” In Shifts towards Image-Centricity in Contemporary Multimodal Practices, ed. by Hartmut Stöckl, Helen Caple, and Jana Pflaeging, 177–203. New York: Routledge. Google Scholar logo with link to Google Scholar
Stöckl, Hartmut. 2004. “In between modes: Language and image in printed media.” In Perspectives on Multimodality, ed. by Eija Ventola, Charles Cassily, and Martin Kaltenbacher, 9–30. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
. 2015. “From text linguistics to multimodality: Mapping concepts and methods across domains.” In Building Bridges for Multimodal Research: International Perspectives on Theories and Practices of Multimodal Analysis, ed. by Janina Wildfeuer, 51–75. Bern: Peter Lang.Google Scholar logo with link to Google Scholar
Tagg, Caroline, and Agnieszka Lyons. 2022. Mobile Messaging and Resourcefulness: A Post-Digital Ethnography. New York: Routledge. Google Scholar logo with link to Google Scholar
Unsworth, Len. 2008. “Multiliteracies and metalanguage: Describing image/text relations as a resource for negotiating multimodal texts.” In Handbook of Research on New Literacies, ed. by Julie Coiro, Michele Knobel, Colin Lankshear, and Donald J. Leu, 377–406. New York: Routledge.Google Scholar logo with link to Google Scholar
Vela Delfa, Cristina. 2020. “Una aproximación semiótica al estudio de los emojis [A semiotic approach to the study of emojis].” Círculo de Lingüística Aplicada a la Comunicación 841: 153–165. Google Scholar logo with link to Google Scholar
Yus, Francisco. 2022. Smartphone Communication: Interactions in the App Ecosystem. Abingdon: Routledge. Google Scholar logo with link to Google Scholar
. 2023. Pragmatics of Internet Humor. Cham: Palgrave Macmillan.Google Scholar logo with link to Google Scholar
. 2025. Emoji Pragmatics. Cham: Palgrave Macmillan. Google Scholar logo with link to Google Scholar
Zappavigna, Michele, and Lorenzo Logi. 2021. “Emoji in social media discourse about working from home.” Discourse, Context & Media 441, 100543. Google Scholar logo with link to Google Scholar
. 2024. Emoji and Social Media Paralanguage. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue