Cover not available

In:Corpus Approaches to Social Media:
Edited by Sofia Rüdiger and Daria Dayter
[Studies in Corpus Linguistics 98] 2020
► pp. 175–196

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload Book PDF
EPUB logo with download linkDownload Book EPUB
authorization required

Chapter 8
Working with images and emoji in the 🦆 Dukki Facebook Corpus

 | Lancaster University
Published online: 4 November 2020
DOI logo with link
https://doi.org/10.1075/scl.98.08col
Abstract
In this chapter, I demonstrate how researchers can incorporate image content and emoji into corpus approaches to social media data. I present data from the Facebook Page of Dukki Gifts & Souvenirs, an independent business based in Nottingham, U.K. and, using a simple annotation scheme, I show how researchers can incorporate image content and emoji into frequency and collocation analysis in order to examine the patterns of use for images in this dataset. I discuss some of the adjustments required to extend approaches conventionally applied to written forms of data to image content, including how this might affect the way we think of core concepts, such as collocation.
Article outline
  • 1.Introduction
  • 2.Encoding multimodal features
    • 2.1Images
    • 2.2Emoji
  • 3.Businesses and social media
  • 4.Dukki and the Dukki Facebook Corpus
    • 4.1Image annotation
  • 5.Frequency and distribution of images and emoji
  • 6.Collocation
    • 6.1Collocates of CANDID images
    • 6.2Collocates of ‘Dukki’
  • 7.Discussion and conclusion
  • Note
  • References
References (54)
References
Adolphs, Svenja & Carter, Ronald. 2013. Spoken Corpus Linguistics: From Monomodal to Multimodal [Routledge Advances in Corpus Linguistics 15]. London: Routledge. Google Scholar logo with link to Google Scholar
Agha, Asif. 2003. The social life of cultural value. Language and Communication 23: 231–273. Google Scholar logo with link to Google Scholar
Baker, Paul, Gabrielatos, Costas, KhosraviNik, Majod, Krzyžanowski, Michał, McEnery, Tony & Wodak, Ruth. 2008. A useful methodological synergy? Combining critical discourse analysis and corpus linguistics to examine discourses of refugees and asylum seekers in the UK press. Discourse & Society 19(3): 273–306. Google Scholar logo with link to Google Scholar
Bateman, John, Wildfeuer, Janina & Hiippala, Tuomo. 2017. Multimodality: Foundations, Research and Analysis – A Problem-Oriented Introduction. Berlin: Mouton de Gruyter. Google Scholar logo with link to Google Scholar
Bednarek, Monika. 2015. Corpus-assisted multimodal discourse analysis of television and film narratives. In Corpora and Discourse Studies: Integrating Discourse and Corpora, Paul Baker & Tony McEnery (eds), 63–87. Houndmills: Palgrave Macmillan. Google Scholar logo with link to Google Scholar
Bednarek, Monika & Caple, Helen. 2017a. The Discourse of News Values: How News Organizations Create Newsworthiness. Oxford: OUP. Google Scholar logo with link to Google Scholar
. 2017b. Introducing a new topology for (multimodal) discourse analysis. In Transforming Contexts: Papers from the 44th International Systemic Functional Congress, Phil Chappell & John S. Knox (eds), 19–25. Wollongong: 44th ISFC Organising Committee.Google Scholar logo with link to Google Scholar
Bou-Franch, Patricia & Blitvich, Pilar Garcés-Conejos. 2018. Relational work in multimodal networked interactions on Facebook. Internet Pragmatics 1(1): 134–160. Google Scholar logo with link to Google Scholar
Bouvier, Gwen & Machin, David. 2018. Critical Discourse Analysis and the challenges and opportunities of social media. Review of Communication 18(3): 178–192. Google Scholar logo with link to Google Scholar
Braber, Natalie & Robinson, Jonnie. 2018. East Midlands English [Dialects of English 15]. Berlin: De Gruyter Mouton. Google Scholar logo with link to Google Scholar
Brezina, Vaclav, McEnery, Tony & Wattam, Stephen. 2015. Collocations in context: A new perspective on collocation networks. International Journal of Corpus Linguistics 20(2): 139–173. Google Scholar logo with link to Google Scholar
Brezina, Vaclav, Timperley, Matt & McEnery, Tony. 2018. #LancsBox v. 4.x [software]. <[URL]> (29 March 2020).
Caple, Helen. 2019. “Lucy says today she is a Labordoodle”: How the dogs-of-Instagram reveal voter preferences. Social Semiotics 29(4): 427–447. Google Scholar logo with link to Google Scholar
Caple, Helen, Bednarek, Monika & Anthony, Laurence. 2018. Using Kaleidographic to visualize multimodal relations within and across texts. Visual Communication 17(4): 461–474. Google Scholar logo with link to Google Scholar
Carr, Caleb T. & Hayes, Rebecca A. 2015. Social media: Defining, developing, and divining. Atlantic Journal of Communication 23(1): 46–65. Google Scholar logo with link to Google Scholar
Chen, Jianfu, Kuznetsova, Polina, Warren, David S. & Choi, Yejin. 2015. Déjà Image-Captions: A corpus of expressive descriptions in repetition. Human Language Technologies: The 2015 Annual Conference of the North American Chapter of the ACL, 504–514. 31 May-5 June 2015, Denver, Colorado.Google Scholar logo with link to Google Scholar
Collins, Luke C. 2019. Corpus Linguistics for Online Communication. London: Routledge. Google Scholar logo with link to Google Scholar
Das, Gopal & Hagtvedt, Henrik. 2016. Consumer responses to combined arousal-inducing stimuli. International Journal of Research in Marketing 33(1): 213–215. Google Scholar logo with link to Google Scholar
Das, Gopal, Wiener, Hillary J. D. & Kareklas, Ioannis. 2019. To emoji or not to emoji? Examining the influence of emoji on consumer reactions to advertising. Journal of Business Research 96: 147–156. Google Scholar logo with link to Google Scholar
Davis, Mark & Edberg, Peter. 2016. Unicode emoji – Unicode technical report #51. <[URL]> (17 October 2019).
Dijkmans, Corné, Kerkhof, Peter & Beukeboom, Camiel J. 2015. A stage to engage: Social media use and corporate reputation. Tourism Management 47: 58–67. Google Scholar logo with link to Google Scholar
Domingo, Myrrh, Jewitt, Carey & Kress, Gunther. 2014. Multimodal social semiotics: Writing in online contexts. In The Routledge Handbook of Contemporary Literary Studies, Jennifer Rowsell & Kate Pahl (eds), 251–266. London: Routledge.Google Scholar logo with link to Google Scholar
Facebook. 2018. Newsroom – A new level of transparency for ads and pages. <[URL]> (30 October 2019).
Fullwood, Chris, Orchard, Lisa J. & Floyd, Sarah A. 2013. Emoticon convergence in internet chat rooms. Social Semiotics 23: 648–662. Google Scholar logo with link to Google Scholar
Ganster, Tina, Eimler, Sabrina C. & Krämer, Nicole C. 2012. Same same but different!? The differential influence of smilies and emoticons on person perception. Cyberpsychology, Behavior, and Social Networking 15(4): 226–230. Google Scholar logo with link to Google Scholar
Gatt, Albert, Tanti, Marc, Muscat, Adrian, Paggio, Patrizia, Farrugia, Reuben A., Borg, Claudia, Camilleri, Kenneth P., Rosner, Michael & van der Plas, Lonneke. 2018. Face2Text: Collecting an annotated image description corpus for the generation of rich face descriptions. In Proceedings of the 11th Edition of the Language Resources and Evaluation Conference (LREC’18). <[URL]> (17 October 2019).
Ge, Jing & Gretzel, Ulrike. 2018. Impact of humour on firm-initiated social media conversations. Information Technology & Tourism 18: 61–83. Google Scholar logo with link to Google Scholar
Ging, Debbie & Garvey, Sarah. 2018. ‘Written in these scars are the stories I can’t explain’: A content analysis of pro-ana and thinspiration image sharing on Instagram. New Media & Society 20(3): 1181–1200. Google Scholar logo with link to Google Scholar
Glaser, Barney & Strauss, Anselm L. 1967. The Discovery of Grounded Theory. Chicago IL: Aldine.Google Scholar logo with link to Google Scholar
Gretry, Anaïs, Horváth, Csilla, Belei, Nina & van Riel, Allard C .R. 2017. “Don’t pretend to be my friend!” When an informal brand communication style backfires on social media. Journal of Business Research 74: 77–89. Google Scholar logo with link to Google Scholar
Hall, Edward T. 1966. The Hidden Dimension. Garden City NY: Doubleday.Google Scholar logo with link to Google Scholar
Hardie, Andrew. 2012. CQPweb – Combining power, flexibility and usability in a corpus analysis tool. International Journal of Corpus Linguistics 17(3): 380–409. Google Scholar logo with link to Google Scholar
KhosraviNik, Majid. 2017. Social Media Critical Discourse Studies (SM-CDS). In Handbook of Critical Discourse Studies, John Flowerdew & John E. Richardson (eds), 582–596. London: Routledge. Google Scholar logo with link to Google Scholar
Law, Locky. 2019. Creativity and television drama: A corpus-based multimodal analysis of pattern-reforming creativity in House M.D. Corpora 14(2): 135–171. Google Scholar logo with link to Google Scholar
Li, Xueni S., Chan, Kimmy Wa & Kim, Sara. 2018. Service with emoticons: How customers interpret employee use of emoticons in online service encounters. Journal of Consumer Research 45(5): 973–987. Google Scholar logo with link to Google Scholar
Luarn, Pin, Lin, Yu-Fan & Chiu, Yu-Ping. 2015. Influence of Facebook brand-page posts on online engagement. Online Information Review 39(4): 505–519. Google Scholar logo with link to Google Scholar
McEnery, Tony & Hardie, Andrew. 2011. Corpus Linguistics: Method, Theory and Practice. Cambridge: CUP. Google Scholar logo with link to Google Scholar
Miller, Hannah, Thebault-Spieker, Jacob, Chang, Shuo, Johnson, Isaac, Terveen, Loren & Hecht, Brent. 2016. “Blissfully Happy” or “Ready to Fight”: Varying interpretations of emoji. In Proceedings of the Tenth International AAAI Conference on Web and Social Media (ICWSM 2016). <[URL]> (17 October 2019).
Myers, Greg. 1996. Words in Ads. London: Edward Arnold.Google Scholar logo with link to Google Scholar
Norris, Sigrid. 2004. Analyzing Multimodal Interaction: A Methodological Framework. London: Routledge. Google Scholar logo with link to Google Scholar
Obar, Jonathan A. & Wildman, Stephen S. 2015. Social media definition and the governance challenge: An introduction to the special issue. Telecommunications Policy 39(9): 745–750. Google Scholar logo with link to Google Scholar
Ordenes, Francisco Villarroel, Gewal, Dhruv, Ludwig, Stephan, De Ruyter, Ko, Mahr, Dominik & Wetzels, Martin. 2019. Cutting through content clutter: How speech and image acts drive consumer sharing of social media brand messages. Journal of Consumer Research 45: 988–1012. Google Scholar logo with link to Google Scholar
Pieters, Rik & Wedel, Michel. 2007. Goal control of attention to advertising: The Yarbus implication. Journal of Consumer Research 34: 224–233. Google Scholar logo with link to Google Scholar
Poor, Morgan, Duhachek, Adam & Krishnan, H. Shanker. 2013. How images of other consumers influence subsequent taste perceptions. Journal of Marketing 77: 124–139. Google Scholar logo with link to Google Scholar
Rodrigues, David, Prada, Marília, Gaspar, Rui, Garrido, Margarida V. & Lopes, Diniz. 2018. Lisbon Emoji and Emoticon Database (LEED): Norms for emoji and emoticons in seven evaluative dimensions. Behavior Research Methods 50: 392–405. Google Scholar logo with link to Google Scholar
Russell, Martha G. 2009. A call for creativity in new metrics for liquid media. Journal of Interactive Advertising 9(2): 44–61. Google Scholar logo with link to Google Scholar
Scollins, Richard & Titford, John. 2000. Ey up mi Duck! Dialect of Derbyshire and the East Midlands. Newbury: Countryside Books.Google Scholar logo with link to Google Scholar
Spina, Stefania. 2019. Role of emoticons as structural markers in Twitter interactions. Discourse Processes 56(4): 345–362. Google Scholar logo with link to Google Scholar
Stubbs, Michael. 2001. Words and Phrases: Corpus Studies of Lexical Semantics. Oxford: Blackwell.Google Scholar logo with link to Google Scholar
Thompson, Roy & Bowen, Christopher J. 2009. Grammar of the Shot. Amsterdam: Focal Press.Google Scholar logo with link to Google Scholar
Wijerante, Sanjaya, Balasuriya, Lakshika, Sheth, Amit & Doran, Derek. 2016. EmojiNet: Building a machine readable sense inventory for emoji. Proceedings of the International Workshop on Social Informatics 10046: 527–541. Google Scholar logo with link to Google Scholar
Wolf, Maxim, Sims, Julian & Yang, Huadong. 2018. Social media? What social media? Paper presented at the Annual Conference of the UK Academy for Information Systems, Oxford. <[URL]> (17 October 2019).
Wondwesen, Tafesse. 2015. Content strategies and audience response on Facebook brand pages. Marketing Intelligence & Planning 33(6): 927–943. Google Scholar logo with link to Google Scholar
Zappavigna, Michele. 2016. Social media photography: Construing subjectivity in Instagram images. Visual Communication 15(3): 271–292. Google Scholar logo with link to Google Scholar
Cited by (4)

Cited by four other publications

Baker, Paul, Hanna Schmück & Yufang Qian
2025. Automatic Image Tagging for Corpus Linguistics, DOI logo
Collins, Luke C & Paul Baker
2025. A computer-assisted analysis of image representations of obesity: comparing UK news content with the World Obesity Federation Image Bank. Visual Communication 24:4 ► pp. 889 ff. DOI logo
Collins, Luke C. & William Platt
2025. Keywords and key emoji: investigating a university’s Twitter posts before, during and after covid-related restrictions. Corpora 20:2 ► pp. 205 ff. DOI logo
Sha, Yuze & Beth Malory
2025. Using ATLAS.ti for constructing and analysing multimodal social media corpora. Linguistics Vanguard DOI logo

This list is based on CrossRef data as of 1 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue