In:Ideophones, Mimetics and Expressives
Edited by Kimi Akita and Prashant Pardeshi
[Iconicity in Language and Literature 16] 2019
► pp. 229–248
Chapter 9Mimetics, gaze, and facial expression in a multimodal corpus of Japanese
Published online: 6 May 2019
https://doi.org/10.1075/ill.16.10aki
https://doi.org/10.1075/ill.16.10aki
Mimetic/ideophonic utterances are often accompanied by expressive prosody and iconic gesture. This chapter reports the speaker’s facial expression and eye contact with the hearer as two more possible nonverbal correlates of mimetics on the basis of a multimodal corpus of Japanese interviews. It is shown that, unlike prosody and gesture, these somewhat frequent facial behaviors are not correlated with the morphosyntactic features of mimetics because of their primarily affective and interactional nature. However, a weak correlation with morphosyntax is suggested for the speaker’s gaze redirected away from the hearer, which is considered a signal of ‘depictive’ signification prototypical mimetics illustrate.
Article outline
- 1.Introduction
- 2.Previous studies
- 2.1Paralinguistic/nonverbal features of ideophones
- 2.2Facial expression and speaker gaze
- 3.Method
- 4.Results
- 5.Discussion
- 6.Conclusions
Acknowledgements Notes References Appendix
References (67)
Akita, K. 2009. A grammar of sound-symbolic words in Japanese: Theoretical approaches to iconic and lexical properties of mimetics. Ph.D. dissertation, Kobe University.
2015. Ideophones and reported discourse as depictive signs. Joint Project on Language & Culture 2014: Theoretical Approaches to Natural Language, 1–10. Osaka University.
2016. Gengo taikei no naka no onomatope [Ideophones in linguistic systems]. In Lexicon Forum, No. 7, T. Kageyama (ed.), 19–39. Tokyo: Hituzi Syobo.
2017a. Gaikokugo ni mo onomatope wa aru no? [Do foreign languages also have mimetics?]. In Onomatope no Nazo: Pikachū kara Mofumofu made [Mysteries of Mimetics: From Pikachu to Mofumofu
], H. Kubozono (ed.), 65–85. Tokyo: Iwanami.
2017b. Grammatical and functional properties of mimetics in Japanese. In The Grammar of Japanese Mimetics: Perspectives from Structure, Acquisition, and Translation, N. Iwasaki, P. Sells and Kimi Akita (eds), 20–34. London: Routledge.
2017c. The linguistic integration of Japanese ideophones and its typological implications. Canadian Journal of Linguistics 62: 314–334.
Akita, K. and Dingemanse, M. 2019. Ideophones (mimetics, expressives). In Oxford Research Encyclopedia of Linguistics, M. Aronoff (ed.), Oxford: Oxford University Press.
Akita, K, Nakamura, S., Komatsu, T. and Hirata, S. 2012. Onomatope no intarakushon-sei ni kansuru ryō-teki kōsatu [A quantitative study of the interactional function of mimetics]. Proceedings of the 26th Annual Conference of the Japanese Society for Artificial Intelligence, 2012, 2N1-OS-8c-5.
Akita, K. and Tsujimura, N. 2016. Mimetics. In The Handbook of Japanese Lexicon and Word Formation, T. Kageyama and H. Kishimoto (eds.), 133–160. Berlin and New York: De Gruyter Mouton.
Akita, K. and Usuki, T. 2016. A constructional account of the “optional” quotative marking on Japanese mimetics. Journal of Linguistics 52: 245–275.
Baba, J. 2003. Pragmatic function of Japanese mimetics in the spoken discourse of varying emotive intensity levels. Journal of Pragmatics 35: 1861–1889.
Bavelas, J. B. and Chovil, N. 1997. Faces in dialogue. In The Psychology of Facial Expression, J. A. Russell and J. M. Fernández-Dols (eds), 334–346. New York: Cambridge University Press.
Bavelas, J. B., Coates, L. and Johnson, T. 2002. Listener responses as a collaborative process: The role of gaze. Journal of Communication 52: 566–580.
Bavelas, J., Gerwing, J. and Healing, S. 2014. Effect of dialogue on demonstrations: Direct quotations, facial portrayals, hand gestures, and figurative references. Discourse Processes 51: 619–655.
Burch, A. R. and Kasper, G. 2016. ‘Like Godzilla’: Enactments and formulations in telling a disaster story in Japanese. In Emotion in Multilingual Interaction, M. T. Prior and G. Kasper (eds), 57–85. Amsterdam and Philadelphia: John Benjamins.
Childs, G. T. 1994. African ideophones. In Sound Symbolism, L. Hinton, J. Nichols, and J. J. Ohala (eds), 178–204. Cambridge: Cambridge University Press.
Diffloth, G. 1972. Notes on expressive meaning. Papers from the Eighth Regional Meeting, the Chicago Linguistic Society, 440–447.
Dingemanse, M. 2011. The meaning and use of ideophones in Siwu. Ph.D. dissertation, Max Planck Institute for Psycholinguistics and Radboud University Nijmegen.
2012. Advances in the cross-linguistic study of ideophones. Language and Linguistics Compass 6: 654–672.
2013. Ideophones and gesture in everyday speech. Gesture 13: 143–165.
2015. Ideophones and reduplication: Depiction, description, and the interpretation of repeated talk in discourse. Studies in Language 39: 946–970.
2017. Expressiveness and system integration: On the typology of ideophones, with special reference to Siwu. STUF – Language Typology and Universals 70: 363–384.
Dingemanse, M. and Akita, K. 2017. An inverse relation between expressiveness and grammatical integration: On the morphosyntactic typology of ideophones, with special reference to Japanese. Journal of Linguistics 53: 501–532.
Dingemanse, M. and Majid, A. 2012. The semantic structure of sensory vocabulary in an African language. In CogSci 2012: Proceedings of the 34th Annual Conference of the Cognitive Science Society, N. Miyake, D. Peebles and R. P. Cooper (eds), 300–305. Austin: Cognitive Science Society.
Ekman, P. 1977. Facial expression. In Nonverbal Communication and Behavior, A. W. Siegman and S. Feldstein (eds), 97–126. Hillsdale, NJ: Lawrence Erlbaum.
Güldemann, T. 2008. Quotative Indexes in African Languages: A Synchronic and Diachronic Survey. Berlin and New York: Mouton de Gruyter.
Hogue, R. L. 2010. OOs and AAs: Mouth gestures as ideophones in American Sign Language. Ph.D. dissertation, Gallaudet University.
Holt, E. 2000. Reporting and reacting: Concurrent responses to reported speech. Research on Language and Social Interaction 33: 425–454.
Kendon, A. 1967. Some functions of gaze direction in social interaction. Acta Psychologica 26: 22–63.
Mihas, E. I. 2012. Ideophones in Alto Perené (Arawak) from Eastern Peru. Studies in Language 36: 300–344.
Nasu, A. 2002. Nihongo onomatope no gokeisei to inritsu kōzō [Word formation and prosodic structure of Japanese mimetics]. Ph.D. dissertation, University of Tsukuba.
Newman, P. 1968. Ideophones from a syntactic point of view. Journal of West African Languages 5: 107–117.
NHK (Japan Broadcasting Corporation). 2012–present. NHK Great East Japan Earthquake Archive. [URL] (last accessed: 26 September 2017)
1996. Sounds like Life: Sound-Symbolic Grammar, Performance, and Cognition in Pastaza Quechua. Oxford: Oxford University Press.
Ohala, J. J. 1994. The frequency code underlies the sound-symbolic use of voice pitch. In Sound Symbolism, L. Hinton, J. Nichols, and J. J. Ohala (eds), 325–347. Cambridge: Cambridge University Press.
O’Reilly, M. 2005. ‘Active noising’: The use of noises in talk, the case of onomatopoeia, abstract sounds, and the functions they serve in therapy. Text 25: 745–762.
Rossano, F. 2013. Gaze in conversation. In The Handbook of Conversation Analysis, J. Sidnell, and T. Stivers (eds), 308–329. Malden: Blackwell.
Russell, J. A. and Fernández-Dols, J. M. (eds). 1997. The Psychology of Facial Expression. Cambridge: Cambridge University Press.
Ruusuvuori, J. 2013. Emotion, affect and conversation. In The Handbook of Conversation Analysis, J. Sidnell and T. Stivers (eds), 330–349. Malden: Blackwell.
Ruusuvuori, J. and Peräkylä, A. 2009. Facial and verbal expression in assessing stories and topics. Research on Language and Social Interaction 43: 377–394.
Sacks, H., Schegloff, E. A. and Jefferson, G. 1974. A simplest systematics for the organization of turn-taking for conversation. Language 50: 696–735.
Sadanobu, T. 2015. Suikō-teki tokushitsu ni motozuku nihongo onomatope no ri/katsuyō [Performative use of Japanese mimetics]. Journal of the Japanese Society for Artificial Intelligence 30: 353–363.
Schourup, L. 1993. Nihongo no kaki-kotoba/hanashi-kotoba ni okeru onomatope no bunpu ni tsuite [On the distribution of mimetics in written and spoken Japanese]. In Onomatopia: Gion/Gitaigo no Rakuen [Onomatopia: A Utopia of Mimetics], H. Kakehi and I. Tamori (eds), 77–100. Tokyo: Keiso Shobo.
Sells, P. 2017. The significance of the grammatical study of Japanese mimetics. In The Grammar of Japanese Mimetics: Perspectives from Structure, Acquisition, and Translation, N. Iwasaki, P. Sells and K. Akita (eds), 7–19. London: Routledge.
Sidnell, J. 2006. Coordinating gesture, talk, and gaze in reenactments. Research on Language and Social Interaction 39: 377–409.
Son, Y. 2010. Giongo/gitaigo to miburi: Terebi hoosoo no maruchimedia kōpasu ni yoru keiryō-teki bunseki [Onomatopoeias and gestures: A multimedia corpus-based quantitative study of Japanese television broadcasts]. Mathematical Linguistics 27: 131–153.
Stec, K., Huiskes, M. and Redeker, G. 2016. Multimodal quotation: Role shift practices in spoken narratives. Journal of Pragmatics 104: 1–17.
Stivers, T. and Rossano, F. 2010. Mobilizing response. Research on Language and Social Interaction 43: 3–31.
Szatrowski, P. 2018. Sōgo sayō ni yoru onomatope no shiyō: Nyū seihin no shishoku kai o rei ni shite [On the use of onomatopoeia in interaction: Examples from Japanese dairy taster brunches]. NINJAL Research Papers 16: 77–106.
Tamori, I. 1980. Cooccurrence restrictions on onomatopoeic adverbs and particles. Papers in Japanese Linguistics 7: 151–171.
Tamori, I. and Schourup, L. 1999. Onomatope: Keitai to Imi [Ideophones: Form and Meaning]. Tokyo: Kurosio Publishers.
Toratani, K. 2017. The position of to/Ø-marked mimetics in Japanese sentence structure. In The Grammar of Japanese Mimetics: Perspectives from Structure, Acquisition, and Translation, N. Iwasaki, P. Sells and K. Akita (eds), 35–72. London: Routledge.
2018. Particle drop of mimetics in Japanese: A Discourse Grammar approach. Cognitive Linguistic Studies 5: 39–60.
Vigliocco, G., Perniss, P. and Vinson, D. 2014 Language as a multimodal phenomenon: implications for language learning, processing and evolution. Philosophical Transactions of the Royal Society B 369: 20130292.
Voeltz, F. K. E. and Kilian-Hatz, C. (eds). 2001. Ideophones. Amsterdam and Philadelphia: John Benjamins.
Cited by (3)
Cited by three other publications
McLean, Bonnie & Mark Dingemanse
Toratani, Kiyoko
2022. Introduction to the volume. In The Language of Food in Japanese [Converging Evidence in Language and Communication Research, 25], ► pp. 1 ff.
This list is based on CrossRef data as of 12 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.
