Cover not available

Article published In: Pragmatics and Society
Vol. 12:2 (2021) ► pp.189–223

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
authorization required

Towards a discourse-semantic approach to visual narrative analysis

The case of the BBC news story of Islamic State (IS)

 | Prince Sattam Bin Abdulaziz University | Kafr El-Sheikh University
Published online: 3 June 2021
DOI logo with link
https://doi.org/10.1075/ps.18045.sal
Abstract
The present study propounds a novel discourse-semantic approach that problematizes the social semiotic analysis of visual narrative in two respects: (i) the lack of a model that can explain the plurifunctional structure of visual acts of communication in general and (ii) the failure to provide the deep structure underlying the characters and/or objects in visual narrative in particular. Redressing these two shortcomings, the approach is methodologically geared towards analysing the visual narrative grammar that encodes the 2017 BBC image-enabled news story of Islamic State (IS). The proposed approach rests on two theoretical models: (i) Roman Jakobson, Roman. 1960. Closing statement: Linguistics and poetics. In: Style in Language, ed. Thomas A. Sebeok, 350–377. Cambridge, Mass.: MIT Press.Google Scholar logo with link to Google Scholar communication model of language functions; (ii) Algirdas Julien Greimas’s (Greimas, Algirdas J. 1966. Sémantique Structurale. Paris: Larousse.Google Scholar logo with link to Google Scholar, 1987. On Meaning: Selected Writings in Semiotic Theory (Trans. Paul J. Perron & Frank H. Collins). Minnesota, Minn.: Minnesota University Press.Google Scholar logo with link to Google Scholar) structural-semantic model of actant grammar. The study has reached two major findings. First, theoretically, the visual narrative analysis of images demands the presence of both (1) a theory that can adequately explain the plurifunctional structure associated with the semiotic complexity of visual communication and (2) a structural-semantic model that reveals the deep structure of the actants that enable the dramatis personae to relate to the events featuring in the mono-/multimodal discourse of narrative. Second, on a practical level of the BBC’s visual storyline, IS has been represented within three actant-based enunciation-spectacles: (a) victimhood with Subject versus Object, (b) beneficiariness with Sender versus Receiver, and (c) villainy (self-presented and other-presented) with Opponent/Victim versus Helper.
Article outline
  • 1.Introduction
  • 2.Problematizing visual narrative analysis in social semiotics
  • 3.Visual narrative grammar: A discourse-semantic approach
    • 3.1Jakobson’s model of language functions
    • 3.2Greimas’s model of actant grammar
  • 4.Methodology
    • 4.1Data and procedure
    • 4.2Research question(s)
  • 5.Transcoding visual narrative grammar in the BBC news story of IS
    • 5.1Functions of the visual acts of communication in the BBC news story of IS
    • 5.2Visual deep structure: Actants and enunciation-spectacles of BBC visual narrative
  • 6.Conclusion: Summary and findings
  • Acknowledgments
  • Notes
  • References
References (68)
References
Arnheim, Rudolf. 1974. Art and Visual Perception. Berkeley: California University Press. Google Scholar logo with link to Google Scholar
Auer, Peter. 2021. Turn-allocation and gaze: A multimodal revision of the “current-speaker-selects-next” rule of the turn-taking system of conversation analysis. Discourse Studies 23(2): 117–140. Google Scholar logo with link to Google Scholar
Bal, Mieke. 1985. Narratology: Introduction to the Theory of Narrative. Toronto: Toronto University Press.Google Scholar logo with link to Google Scholar
Barthes, Roland. 1972. Myth today. In: Mythologies, Roland Barthes, 109–137. (Trans. Annette Lavers). New York: Hill & Wang.Google Scholar logo with link to Google Scholar
. 1977. Image-Music-Text. (Ed. & Trans. Stephen Heath). London: Fontana.Google Scholar logo with link to Google Scholar
Bateman, John A. & Janina Wildfeuer. 2014. A multimodal discourse theory of visual narrative. Journal of Pragmatics 741: 180–208. Google Scholar logo with link to Google Scholar
Bell, Allan. 1996. Text, time and technology in news English. In: Redesigning English: New Texts, New Identities, eds. Sharon Goodman & David Graddol, 3–26. London and New York: Routledge.Google Scholar logo with link to Google Scholar
Bertin, Jacques. 1983 [1967]. Semiology of Graphics: Diagrams, Networks, Maps. (Trans. W. J. Berg). London: University of Wisconsin Press.Google Scholar logo with link to Google Scholar
Bo, Xu. 2018. Multimodal discourse analysis of the movie Argo. English Language Teaching 11 (4): 132–137. Google Scholar logo with link to Google Scholar
Caple, Helen. 2019. Doing critical discourse studies with multimodality: A reply. Critical Discourse Studies 16(5): 522–530. Google Scholar logo with link to Google Scholar
Chandler, Daniel. 2007. Semiotics: The Basics (2nd ed.). London & New York: Routledge. Google Scholar logo with link to Google Scholar
Chatman, Seymour. 1978. Story and Discourse: Narrative Structure in Fiction and Film. Ithaca, N.Y. & London: Cornell University Press.Google Scholar logo with link to Google Scholar
Chen, Yaoyao, Svenja Adolphs & Dawn Knight. 2020. Multimodal discourse analysis. In: The Routledge Handbook of Corpus Approaches to Discourse Analysis, eds. Eric Friginal & Jack A. Hardy, 98–115. London and New York: Routledge. Google Scholar logo with link to Google Scholar
Colby, Benjamin N. 1966. The analysis of culture content and the patterning of narrative concern in texts. American Anthropologist 68(2): 374–388. Google Scholar logo with link to Google Scholar
1970. The description of narrative structures. In: Cognition: A Multiple View, ed. Paul L. Garvin, 177–192. New York: Spartan Books.Google Scholar logo with link to Google Scholar
Culler, Jonathan. 1976. Saussure. London: Fontana.Google Scholar logo with link to Google Scholar
Dondis, Donis A. 1973. A Primer of Visual Literacy. Cambridge, Mass.: MIT Press.Google Scholar logo with link to Google Scholar
Fish, Stanley. 1980. Is There a Text in This Class? The Authority of Interpretive Communities. Cambridge, Mass.: Harvard University Press.Google Scholar logo with link to Google Scholar
Friedland, Elliot. 2014. Special report: The Islamic State. The Clarion Project, November 2014: 1–15.Google Scholar logo with link to Google Scholar
Genette, Gérard. 1980 [1972]. Narrative Discourse: An Essay in Method (Trans. J. E. Lewin). Oxford: Blackwell, Trans. of Discours du récit: Essais de méthode.Google Scholar logo with link to Google Scholar
Goodman, Sharon. 1996. Visual English. In: Redesigning English: New Texts, New Identities, ed. Sharon Goodman & David Graddol, 38–72. London and New York: Routledge.Google Scholar logo with link to Google Scholar
Goodman, Sharon & David Graddol (eds). 1996. Redesigning English: New Texts, New Identities. London & New York: Routledge.Google Scholar logo with link to Google Scholar
Gombrich, Ernst. 1960. Art and Illusion. London: Phaidon.Google Scholar logo with link to Google Scholar
Granström, Björn, David House & Inger Karlsson. 2002. Multimodality in Language and Speech Systems. Stockholm: Kluwer. Google Scholar logo with link to Google Scholar
Greimas, Algirdas J. 1966. Sémantique Structurale. Paris: Larousse.Google Scholar logo with link to Google Scholar
1970. Du Sens. Paris: Seuil.Google Scholar logo with link to Google Scholar
1971. Narrative grammar: Units and levels. Modern Language Notes 861: 793–806.Google Scholar logo with link to Google Scholar
1983. Du Sens II: Essais Sémiotiques. Paris: Seuil.Google Scholar logo with link to Google Scholar
1987. On Meaning: Selected Writings in Semiotic Theory (Trans. Paul J. Perron & Frank H. Collins). Minnesota, Minn.: Minnesota University Press.Google Scholar logo with link to Google Scholar
1988 [1976]. Maupassant. The Semiotics of Text: Practical Exercises. Trans. Paul J. Perron. Amsterdam: John Benjamins. (Trans. of Maupassant, La sémiotique du texte.) Google Scholar logo with link to Google Scholar
Greimas, Algirdas J. & Joseph Courtés. 1982 [1979]. Semiotics and Language: An analytical Dictionary (Trans. Larry Crist & Daniel Patte). Bloomington: Indiana University Press. (Trans. of Sémiotique. Dictionnaire Raisonné de la Thèorie du Langage.)Google Scholar logo with link to Google Scholar
Gruber, Christiane & Sune Haugbolle (eds). 2013. The Visual Culture in the Modern Middle East: Rhetoric of the Image. Bloomington and Indiana: Indiana University Press.Google Scholar logo with link to Google Scholar
Hall, Stuart. 1972. The determinations of news photographs. Cultural Studies 31: 226–243.Google Scholar logo with link to Google Scholar
Halliday, Michael A. K. 1978. Language as Social Semiotic. London: Edward Arnold.Google Scholar logo with link to Google Scholar
1985. An Introduction to Functional Grammar. London: Edward Arnold.Google Scholar logo with link to Google Scholar
1989. Language, Context, and Text: Aspects of Language in a Social-Semiotic Perspective (2nd ed.). Oxford: Oxford University Press.Google Scholar logo with link to Google Scholar
Halliday, Michael A. K. & Christian M. I. M. Mathiessen. 2004. An Introduction to Functional Grammar (3rd ed.). London: Hodder Education.Google Scholar logo with link to Google Scholar
Hawkes, Terence. 1977. Structuralism & Semiotics. London: Methuen. Google Scholar logo with link to Google Scholar
Herman, David. 2002. Story Logic: Problems and Possibilities of Narrative. Lincoln: Nebraska University Press.Google Scholar logo with link to Google Scholar
Hiippala, Tuomo. 2016. The Structure of Multimodal Documents: An Empirical Approach. New York: Routledge.Google Scholar logo with link to Google Scholar
Hodge, Robert & Gunther Kress. 1988. Social Semiotics. Cambridge: Polity Press.Google Scholar logo with link to Google Scholar
Jakobson, Roman. 1960. Closing statement: Linguistics and poetics. In: Style in Language, ed. Thomas A. Sebeok, 350–377. Cambridge, Mass.: MIT Press.Google Scholar logo with link to Google Scholar
Jaworski, Adam & Nikolas Coupland (eds.). 2006. The Discourse Reader (2nd ed.). New York: Routledge.Google Scholar logo with link to Google Scholar
Jewitt, Carey & Rumiko Oyama. 2001. Visual meaning: A social semiotic approach. In: Handbook of Visual Analysis, eds. Theo van Leeuwen & Carey Jewitt, 134–156. London & New Delhi: Sage.Google Scholar logo with link to Google Scholar
Kress, Gunther. 2010. Multimodality: A Social Semiotic Approach to Contemporary Communication. New York: Routledge.Google Scholar logo with link to Google Scholar
Kress, Gunther & Theo van Leeuwen. 1996. Reading Images: The Grammar of Visual Design. New York: Routledge.Google Scholar logo with link to Google Scholar
. 2006. Reading Images: The Grammar of Visual Design (2nd ed.). London & New York: Routledge. Google Scholar logo with link to Google Scholar
Lemke, Jay L. 1998. Multiplying meaning: Visual and verbal semiotics in scientific text. In: Reading Science: Critical and Functional Perspectives, eds. James R. Martin & Robert Veel, 87–113. London: Routledge.Google Scholar logo with link to Google Scholar
Liu, Jing. 2013. Visual images interpretive strategies in multimodal texts. Journal of Language Teaching and Research 6, 4, 1259–1263. Google Scholar logo with link to Google Scholar
Liu, Yu & Kay L. O’Halloran. 2009. Intersemiotic texture: Analyzing cohesive devices between language and images. Social Semiotics 19(4): 367–388. Google Scholar logo with link to Google Scholar
Muir, Jim. 2017. “Islamic State”: Raqqa’a loss seals IS’s rapid rise and fall. BBC News Online 17 October 2017. Retrieved 30 November 2018, from [URL]
Norris, Sigrid. (ed.) 2012. Multimodality in Practice: Investigating Theory-in-Practice-through-Methodology. New York: Routledge. Google Scholar logo with link to Google Scholar
Nöth, Winfried. 1990. Handbook of Semiotics. Bloomington: Indiana University Press. Google Scholar logo with link to Google Scholar
Nuttall, Louise. 2018. Mind Style and Cognitive Grammar: Language and Worldview in Speculative Fiction. London: Bloomsbury Academic.Google Scholar logo with link to Google Scholar
O’Halloran, Kay L. & Bradley A. Smith. (eds.). 2011. Multimodal Studies: Exploring Issues and Domains. New York: Routledge.Google Scholar logo with link to Google Scholar
Ortner, Sherry B. 1973. On key symbols. American Anthropologist 75(5): 1338–1346. Google Scholar logo with link to Google Scholar
Propp, Vladimir J. 1968 [1928]. Morphology of the Folktale (2nd ed.). Austin, Tex.: University of Texas Press.Google Scholar logo with link to Google Scholar
Rimmon-Kenan, Shlomith. 1983. Narrative Fiction: Contemporary Poetics. London: Methuen. Google Scholar logo with link to Google Scholar
Saussure, Ferdinand de. 1916. Cours de linguistique générale. Paris: Payot.Google Scholar logo with link to Google Scholar
Schleifer, Ronald. 1987. A. J. Greimas and the Nature of Meaning: Linguistics, Semiotics and Discourse Theory. London and Sydney: Croom Helm.Google Scholar logo with link to Google Scholar
Scott, Linda M. 1994. Images in advertising: The need for a theory of visual rhetoric. Journal of Consumer Research 21 (2): 252–273. Google Scholar logo with link to Google Scholar
Thibault, Paul J. 1991. Social Semiotics as Praxis. Minneapolis, Minn.: University of Minnesota Press.Google Scholar logo with link to Google Scholar
2004. Agency and Consciousness in Discourse: Self-Other Dynamics as a Complex System. London & New York: Continuum.Google Scholar logo with link to Google Scholar
Thompson, Philip & Peter Davenport. 1982. The Dictionary of Visual Language. Harmondsworth: Penguin.Google Scholar logo with link to Google Scholar
Todorović, Tijana, Alenka Čuden, Karin Košak & Tomaž Toporišič. 2017. Language of dressing as a communication system and its functions – Roman Jakobson’s linguistic method. FIBRES & TEXTILE in Eastern Europe; 25(5): 1251, 127–135. Google Scholar logo with link to Google Scholar
Van Leeuwen, Theo. 2005. Introducing Social Semiotics. London & New York: Routledge.Google Scholar logo with link to Google Scholar
. 2008. Discourse and Practice: New Tools for Critical Discourse Analysis. Oxford: Oxford University Press. Google Scholar logo with link to Google Scholar
Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue