Cover not available

In:Metapragmatics of Humor: Current research trends
Edited by Leonor Ruiz-Gurillo
[IVITRA Research in Linguistics and Literature 14] 2016
► pp. 235–254

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload Book PDF
authorization required

Smiling, gaze, and humor in conversation

A pilot study

 | Texas A&M University — Commerce, Applied Linguistics Laboratory
 | Texas A&M University — Commerce, Applied Linguistics Laboratory
 | Texas A&M University — Commerce, Applied Linguistics Laboratory
Published online: 24 November 2016
DOI logo with link
https://doi.org/10.1075/ivitra.14.12gir
Abstract
This paper presents a pilot study, which is part of a larger research project intended to shed light on the role of smiling as a marker of humor in naturalistic conversation. Building on previous research (Attardo, Pickering, and Baker 2011; Calvo, Fernández-Martín, and Nummenmaa 2013; Calvo, Gutiérrez-García, Avero, and Lundqvist 2013; Heerey and Crossley 2013), a mixed methods approach was adopted to collect qualitative and quantitative data in order to determine if there is a relationship between gaze patterns, humorous events, and the smiling behavior of native English speakers taking part in a dyadic face-to-face conversation. Preliminary results show that occurrence of humor and increased participants’ attention to the mouth and eyes areas of the interlocutor’s face tend to co-occur.
Article outline
  • 1.Introduction
  • 2.Humor in interaction
  • 3.Eye-tracking in interaction
  • 4.Eye-tracking and humor in conversation
    • 4.1Method
      • 4.1.1Eye-tracking set-up
      • 4.1.2Participants
      • 4.1.3Data collection
    • 4.2Pilot study
      • 4.2.1Results
  • 5.Discussion of results
  • Acknowledgements
  • References
  • Appendix
References (62)
References
Ajmer, Karin and Anne-Marie, Simon-Vandenbergen. 2011. Pragmatic markers. In Jan Zienkowski, Jan-Ola Östman, and Jef Verschueren (Eds.), Discursive Pragmatics. Amsterdam: Benjamins. 223–247. Google Scholar logo with link to Google Scholar
Annoli, Luigi, and Lambiase, Laura. 1990. ““Giochi di sguardo” nella conversazione.” Giornale Italiano di psicologia XVII(1): 27–58.Google Scholar logo with link to Google Scholar
Attardo, Salvatore. 1994. Linguistic Theories of Humor. Berlin: Mouton de Gruyter.Google Scholar logo with link to Google Scholar
. 2001. Humorous Texts. Berlin: Mouton de Gruyter. Google Scholar logo with link to Google Scholar
. 2012. “Smiling, Laughter, and Humor.” In Paolo Santangelo (Ed.), Laughing in Chinese. Rome: Aracne. 421–436.Google Scholar logo with link to Google Scholar
. 2015. “Humor and Laughter.” In Deborah Tannen, Heidi E. Hamilton, and Deborah Schiffrin (Eds.), The Handbook of Discourse Analysis, Second edition. Chichester, UK: John Wiley and Sons. 168–188.Google Scholar logo with link to Google Scholar
. (Forthcoming). The GTVH and Humorous Discourse.
Attardo, Salvatore, and Pickering, Lucy. 2011. “Timing in the performance of jokes.” Humor: International Journal of Humor Research 24(2): 233–250 Google Scholar logo with link to Google Scholar
Attardo, Salvatore, Pickering, Lucy, and Baker, Amanda. 2011. “Prosodic and Multimodal Markers of Humor in Conversation.” Pragmatics and Cognition, 19(2): 224–247. Google Scholar logo with link to Google Scholar
Attardo, Salvatore, Pickering, Lucy, Lomotey, Fofo, Menjo, Shigehito. 2013. “Multimodality in Conversational Humor.” Review of Cognitive Linguistics, 11(2): 400–414. Google Scholar logo with link to Google Scholar
Attardo, Salvatore and Raskin, Victor. 1991. “Script theory revis(it)ed: joke similarity and joke representation model.” HUMOR, 4(3): 293–347.Google Scholar logo with link to Google Scholar
Attardo, Salvatore, Wagner, Manuela, and Urios-Aparisi, Eduardo. 2011. “Prosody and Humor.” Prosody and Humor. Special issue of Pragmatics and Cognition, 19(2): 189–201. Google Scholar logo with link to Google Scholar
Barisic, Iva, Timmermans, Bert, Pfeiffer, Bente, Gary, Ulrich J., Vogeley, Kay, and Schilbach, Leonhard. 2013. “Using dual eye-tracking to investigate real-time social interactions.” Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems.Google Scholar logo with link to Google Scholar
Beattie, Geoffrey W. 1978. “Floor apportionment and gaze in conversational dyads.” British Journal of Social and Clinical Psychology, 17(1): 7–15. Google Scholar logo with link to Google Scholar
Brône, Geert and Oben, Bert. 2015. “InSight Interaction: a multimodal and multifocal dialogue corpus.” Language Resources and Evaluation, 49(1): 195–214. Google Scholar logo with link to Google Scholar
Broz, Frank, Lehmann, Hagen, Nehaniv, Chrystopher L., and Dautenhahn, Kerstin. 2012. “Mutual Gaze, Personality, and Familiarity: Dual Eye-Tracking During Conversation.” IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication, 858–864.Google Scholar logo with link to Google Scholar
Calvo, Manuel G., Fernández-Martín, Andrés, and Nummenmaa, Lauri. 2013. “A smile biases the recognition of eye expressions: Configural projection from a salient mouth.” The Quarterly Journal of Experimental Psychology, 66(6): 1159–1181. Google Scholar logo with link to Google Scholar
Calvo, Manuel G., Gutiérrez-García, Aida, Avero, Pedro, and Lundqvist, Daniel. 2013. “Attentional Mechanisms in Judging Genuine and Fake Smiles: Eye-Movement Patterns.” Emotion, 13(4): 792–802. Google Scholar logo with link to Google Scholar
Canestrari, Carla. 2010. “Meta-communicative signals and humorous verbal Interchanges: A case study.” Humor. International Journal of Humor Research, 23 (3): 327–349. Google Scholar logo with link to Google Scholar
Cary, Mark S. 1978. “The role of gaze in the initiation of conversation.” Social Psychology, 41: 269–271. Google Scholar logo with link to Google Scholar
Clark, Alan T., and Gergle, Darren. 2011. “Mobile Dual Eye-Tracking Methods: Challenges and Opportunities.” Paper presented at DUET 2011: Dual Eye-tracking Workshop at ECSCW 2011 (Aarhus, Denmark. September 25, 2011.)
Creswell, John W. and Plano Clark, Vicky L. 2011. Designing and conducting mixed methods research (2nd ed.). Thousand Oaks, CA: Sage.Google Scholar logo with link to Google Scholar
Duchowsky, Andrew. 2007. Eye-tracking Methodology: Theory and Practice. London: Springer-Verlag.Google Scholar logo with link to Google Scholar
Ekman, Paul, and Friesen, Wallace V. 1978. Facial Action Coding System. Palo Alto, CA: Consulting Psychologists Press.Google Scholar logo with link to Google Scholar
Eisterhold, Jody, Attardo, Salvatore, and Boxer, Diana. 2006. “Reactions to irony in discourse: Evidence of the Least Disruption Principle.” Journal of Pragmatics, 38(8): 1239–1256. Google Scholar logo with link to Google Scholar
Fernández-Martín, Andres and Calvo, Manuel. 2012. “Curso temporal en la discriminación de la sonrisa: medidas de latencia sacádica.� �Psicológica, 33: 319–343.Google Scholar logo with link to Google Scholar
Fernández-Martín, Andres, Gutiérrez-García, Aida and Gutiérrez-Calvo, Manuel G. 2013. “A smile radiates outwards and biases the eye expression”.� �Spanish Journal of Psychology 16(53): 1–11. .Google Scholar logo with link to Google Scholar
Gironzetti, Elisa and Menjo, Shigehito. 2014. “Smiling as a Discourse Marker of Humor.” Paper presented at the 2nd Conference of the American Pragmatics Association (AMPRA), October 17-19, 2014, University of California, Los Angeles.
Hall, Edward T. and Mildred Reed Hall. 1990. Understanding cultural difference. Yarmouth, Me: Intercultural Press.Google Scholar logo with link to Google Scholar
Harker, LeeAnne and Dacher Keltner. 2001. “Expressions of Positive Emotion in Women’s College Yearbook Pictures and Their Relationship to Personality and Life Outcomes Across Adulthood.” Journal of Personality and Social Psychology, 80(1): 112–124. Google Scholar logo with link to Google Scholar
Hayhoe, Mary M. and Dana H. Ballard. 2005. “Eye Movements in Natural Behavior.” Trends in Cognitive Science 9(4): 188–194. Google Scholar logo with link to Google Scholar
Heerey, Erin A. and Crossley, Helen M. 2013. “Predictive and Reactive Mechanisms in Smile Reciprocity.” Psychological Science, 24(8): 1446–1455. Google Scholar logo with link to Google Scholar
Hertenstein, Matthew J., Hansel, Carrie A., Butts, Alissa M., and Hile, Sarah N. 2009. “Smile intensity in photographs predicts divorce later in life.” Motivation and Emotion, 33(2): 99–105. Google Scholar logo with link to Google Scholar
Hess, Ursula, and Bourgeois, Patrick. 2010. “You smile — I smile: Emotion expression in social interaction.” Biological Psychology, 84: 514–520. Google Scholar logo with link to Google Scholar
Jandt, Fred E. 2010. An Introduction to Intercultural Communication: Identities in a Global Community. Los Angeles: Sage.Google Scholar logo with link to Google Scholar
Jefferson, Gail. 1979. “A technique for inviting laughter and its subsequent acceptance declination.” In Psathas, George (Ed.), Everyday Language. Studies in Ethnomethodology. New York: Irvington. 79–96.Google Scholar logo with link to Google Scholar
Kendon, Adam. 1967. “Some functions of gaze-direction in social interaction.” Acta Psychologica, 26: 22–63. Google Scholar logo with link to Google Scholar
Kleinke, Chris L. 1986. “Gaze and Eye Contact: A Research Review.” PsyChological Bulletin, 100(1): 78–100. Google Scholar logo with link to Google Scholar
Knackstedt, Georgia, and Kleinke, Chris. 1991. “Eye contact, gender, and personality judgments.” The Journal of Social Psychology, 131: 303–304. Google Scholar logo with link to Google Scholar
Kothoff, Helga. 2003. “Responding to irony in different contexts: On cognition in conversation.” Journal of Pragmatics, 35: 1387–1411. Google Scholar logo with link to Google Scholar
Levine, Marion H., and Sutton-Smith, Brian. 1973. “Effects of age, sex and task on visual behavior during dyadic interaction.” Developmental Psychology, 9: 40–405. Google Scholar logo with link to Google Scholar
Norrick, Neal R. 1993. Conversational joking: Humor in everyday talk. Bloomington, IN: Indiana University Press.Google Scholar logo with link to Google Scholar
O’Donnell-Trujillo, Nick, and Adams, Katherine. 1983. “Heheh in conversation: some coordinating accomplishments of laughter.” Western Journal of Speech Communication, 47: 175–191. Google Scholar logo with link to Google Scholar
Olsen, Anneli. 2012. “The Tobii I-VT Fixation Filter. Algorithm description.” Retrieved from Tobii White Papers Library, [URL].
Oveis, Christopher, Gruber, June, Keltner, Dacher, Stamper, Juliet L., and Boyce, Thomas W. 2009. “Smile Intensity and Warm Touch as Thin Slices of Child and Family Affective Style.” Emotion, 9(4): 544–548. Google Scholar logo with link to Google Scholar
Paxton, Alexandra, and Dale, Rick. 2013. “Argument disrupts interpersonal synchrony.” Quarterly Journal of Experimental Psychology, 66(11): 2092–2102. Google Scholar logo with link to Google Scholar
Pickering, Lucy, Corduas, Marcela, Eisterhold, Jody, Seifried, Brenna, Eggleston, Alyson, and Salvatore Attardo. (2009). “Prosodic Markers of Saliency in Humorous Narratives.” Discourse Processes, 46: 517–540. Google Scholar logo with link to Google Scholar
Raidt, Stephan, Bailly, Gérard, and Elisei, Frédéric. 2007. “Analyzing and modeling gaze during face-to-face interactions.” 7th International Conference on Intelligent Virtual Agents (IVA), Paris, France, 100–101. Google Scholar logo with link to Google Scholar
Raskin, Victor. 1985. Semantic Mechanisms of Humor. Dodrecht: D. Reidel.Google Scholar logo with link to Google Scholar
Richardson, Daniel C., Dale, Rick, and Kirkham, Natasha. 2007. “The art of conversation is coordination: common ground and the coupling of eye movements during dialogue.” Psychological Science, 18: 407–413. Google Scholar logo with link to Google Scholar
Rosengrant, Davod, Hearrington, Doug, Alvarado, Kerriann, and Keeble, Danielle. 2012. “Following Student Gaze Patterns in Physical Science Lectures.” AIP Conference Proceedings, 1413: 323–326. Google Scholar logo with link to Google Scholar
Sacks, Harvey. 1974. [1989]. “An analysis of the course of a joke’s telling in conversation.” In Bauman, R. and Joel Sherzer (Eds.) Explorations in the Ethnography of Speaking. 2nd edition. 337–353. Cambridge, UK: Cambridge University Press.Google Scholar logo with link to Google Scholar
Schegloff, Emauel. A., Jefferson, Gail., and Sacks Harvey. 1977. “The preference for self-correction in the organization of repair in conversation.” Language, 53: 361–82. Google Scholar logo with link to Google Scholar
Seder, Patrick J., and Oishi, Shigehiro. 2012. “Intensity of smiling in facebook photos predicts future life satisfaction.” Social Psychological and Personality Science, 3(4): 407–413. Google Scholar logo with link to Google Scholar
Tsakona, Villy. 2013. “Okras and the metapragmatic stereotypes of humour: Towards an expansion of the GTVH”. In M. Dynel (Ed.), Developments in Linguistic Humour Theory. Amsterdam: John Benjamins. 25–48. Google Scholar logo with link to Google Scholar
Vertegaal, Roel, Slagter, Robert, van der Veer, Gerrit, and Nijholt, Anton. 2001. “Eye Gaze patterns in Conversation: There is More to Conversational Agents Than Meets the Eyes.” CHI 3(1): 301–308.Google Scholar logo with link to Google Scholar
Ye, Zhefan, Li, Yin, Fathi, Alireza, Han, Yi, Rozga, Agata, Abowd, Gregory, D., and Rehg, James M. 2012. “Detecting eye contact using wearable eye-tracking glasses.” Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp’12). ACM, New York, NY, USA, 699–704. Google Scholar logo with link to Google Scholar
Yu, Che, Scheutz, Matthias, and Schermerhorn, Paul W. 2010. “Investigating multimodal real-time patterns of joint attention in an HRI Word Learning Task.” 5th ACM/IEEE International Conference on Human-Robot Interaction, 309–316. Google Scholar logo with link to Google Scholar
Wild, Barbara, Erb, Michael, Eyb, Michael, Bartels, Mathias, and Grodd, Wolfgang. 2003. “Why are smiles contagious? An fMRI study of the interaction between perception of facial affect and facial movements.” Psychiatry Research, 123: 17–36. Google Scholar logo with link to Google Scholar
Williams, Jason A., Burns, Erin L., and Harmon, Elizabeth A. 2009. “Insincere Utterances and gaze: Eye Contact During Sarcastic Statements.” Perceptual and Motor Skills, 108: 565–572. Google Scholar logo with link to Google Scholar
Cited by (16)

Cited by 16 other publications

Kiderle, Thomas, Cristina Georgiana Dobre, Jauwairia Nasir, Carlos Gonzalez Diaz, Hannes Ritschel, Stina Klein, Silvan Mertes & Elisabeth André
2025. Proceedings of the 25th ACM International Conference on Intelligent Virtual Agents, ► pp. 1 ff. DOI logo
Martucci, Alessia, Daniela Graziani, Eva Bei, Luca Bischetti, Valentina Bambini, Mustafa Can Gursesli, Andrea Guazzini & Chiara Pecini
2025. Emotional engagement in a humor-understanding reading task: an AI study perspective. Current Psychology 44:9 ► pp. 7818 ff. DOI logo
Tabacaru, Sabina
2025. “That was really a productive segment, wasn’t it?” Nonverbal markers of humor in the American presidential debates of 2016 and 2020. Frontiers in Psychology 15 DOI logo
Lehmann, Claudia
2024. Multimodal constructions revisited. Testing the strength of association between spoken and non-spoken features of Tell me about it . Cognitive Linguistics 35:3 ► pp. 407 ff. DOI logo
Lin, Bingbing & Jagdish Kaur
2024. ELF speakers’ expert use of humor: catalyzing rapport in initial intercultural online video chat. Journal of English as a Lingua Franca 13:2 ► pp. 285 ff. DOI logo
Amoyal, Mary, Roxane Bertrand, Brigitte Bigi, Auriane Boudin, Christine Meunier, Berthille Pallaud, Béatrice Priego-Valverde, Stéphane Rauzy & Marion Tellier
2022. Principes et outils pour l’annotation des corpus. TIPA. Travaux interdisciplinaires sur la parole et le langage :38 DOI logo
Amoyal, Mary, Marco Cappellini, Christelle Combe, Berthille Pallaud, Béatrice Priego-Valverde & Marion Tellier
2022. Multimodalité(s) dans les interactions humaines. TIPA. Travaux interdisciplinaires sur la parole et le langage :38 DOI logo
Ladilova, Anna & Ulrike Schröder
2022. Humor in intercultural interaction: A source for misunderstanding or a common ground builder? A multimodal analysis. Intercultural Pragmatics 19:1 ► pp. 71 ff. DOI logo
Rauzy, Stéphane & Mary Amoyal
2022. Automatic tool to annotate smile intensities in conversational face-to-face interactions. Gesture 21:2-3 ► pp. 320 ff. DOI logo
de Vries, Clarissa, Bert Oben & Geert Brône
2021. Exploring the role of the body in communicating ironic stance. Languages and Modalities 1 ► pp. 65 ff. DOI logo
Ritschel, Hannes, Thomas Kiderle, Klaus Weber, Florian Lingenfelser, Tobias Baur & Elisabeth André
2020. Multimodal Joke Generation and Paralinguistic Personalization for a Socially-Aware Robot. In Advances in Practical Applications of Agents, Multi-Agent Systems, and Trustworthiness. The PAAMS Collection [Lecture Notes in Computer Science, 12092], ► pp. 278 ff. DOI logo
Attardo, Salvatore
2019. Chapter 8. Humor and mirth. In Emotion in Discourse [Pragmatics & Beyond New Series, 302], ► pp. 189 ff. DOI logo
Attardo, Salvatore
2020. Humor. In Handbook of Pragmatics [Handbook of Pragmatics, ], ► pp. 155 ff. DOI logo
Gironzetti, Elisa, Salvatore Attardo & Lucy Pickering
2019. Smiling and the Negotiation of Humor in Conversation. Discourse Processes 56:7 ► pp. 496 ff. DOI logo
Sülflow, Michael & Marcus Maurer
2019. The Power of Smiling. How Politicians’ Displays of Happiness Affect Viewers’ Gaze Behavior and Political Judgments. In Visual Political Communication, ► pp. 207 ff. DOI logo
[no author supplied]
2022. The Multimodal Performance of Conversational Humor [Figurative Thought and Language, 13], DOI logo

This list is based on CrossRef data as of 12 november 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue