Article published In: Information Design Journal
Vol. 25:3 (2019) ► pp.249–258
Information design and multimodality
New possibilities for engagement across theory and practice
Published online: 22 October 2020
https://doi.org/10.1075/idj.25.3.02bat
https://doi.org/10.1075/idj.25.3.02bat
Abstract
Despite a long association between information design and semiotics, connections remain limited in many respects. This contribution argues that one reason for this is the traditionally weak connection between semiotics and empirical methods. To counter this, a model of multimodal communication is introduced in which theoretical description and empirical research are tightly bound methodologically. Several illustrations of the relevance of the model for information design are offered.
Keywords: multimodality, semiotics, empirical methods
Article outline
- 1.Introduction: A missing puzzle piece
- 2.The semiotics of semiotic modes
- 3.Consequences of the model
- 4.Description and mapping design choices
- 5.Experimentation and prediction
- 6.Conclusions and outlook
- Notes
References
References (20)
Adami, E. (2017). Multimodality. In O. García, N. Flores, & M. Spotti (Eds.), The Oxford handbook of language and society (pp. 451–472). Oxford: Oxford University Press.
Bateman, J. A. (2018). Peircean semiotics and multimodality: Towards a new synthesis. Multimodal Communication, 7(1).
(2019). Transmediality and the end of disembodied semiotics. International Journal of Semiotics and Visual Rhetoric, 3(2), 1–23.
Bateman, J. A., Beckmann, A., & Varela, R. (2018). From empirical studies to visual narrative organization: Exploring page composition. In A. Dunst, J. Laubrock, & J. Wildfeuer (Eds.), Empirical comics research. Digital, multimodal, and cognitive methods (pp. 127–153). London: Routledge.
Bateman, J. A. & Schmidt-Borcherding, F. (2018). The communicative effectiveness of education videos: Towards an empirically-motivated multimodal account. Multimodal Technologies and Interaction, 2(3), 59.
Bateman, J. A., Veloso, F. O., & Lau, Y. L. (2019). On the track of visual style: A diachronic study of page composition in comics and its functional motivation. Visual Communication.
Bateman, J. A., Wildfeuer, J., & Hiippala, T. (2017). Multimodality – foundations, research and analysis. A problem-oriented introduction. Berlin: de Gruyter Mouton.
Black, A., Luna, P., Lund, O., & Walker, S. (2017). Information design: Research and practice. London: Routledge.
Drucker, J. & McGann, J. (2001). Images as the text: Pictographs and pictographic rhetoric. Information Design Journal, 10(2), 95–106.
Farias, P. L. & Queiroz, J. (2006). Images, diagrams, and metaphors: Hypoicons in the context of Peirce’s Sixty-six-fold classification of signs. Semiotica, 1621, 287–308.
Frascara, J. (2017). Review: Information design, research and practice. Information Design Journal, 23(2), 238–242.
Goodman, N. (1969). Languages of Art. An approach to a theory of symbols. London: Oxford University Press.
Kress, G. (2004). Reading images: Multimodality, representation and new media. Information Design Journal, 12(2), 110–119.
Morrissy, S. (2017). Inexplicable in the last resort: A critique of Theo van Leeuwen’s identification of typography as a ‘mode’. Information Design Journal, 23(2), 184–193.
Skaggs, S. (2017). The semiotics of non-virtuous data visualization: Why information design can never be pure. Information Design Journal, 23(2), 219–233.
Sless, D. (1984). Reading semiotics. Information Design Journal, 4(3), 179–189.
(2017). From Semiotics to Choreography. Information Design Journal, 23(2), 173–183.
Tseng, C. I., Laubrock, J., & Pflaeging, J. (2018). Character Developments in comics and graphic novels: A systematic analytical scheme. In A. Dunst, J. Laubrock, & J. Wildfeuer (Eds.), Empirical comics research. Digital, multimodal, and cognitive methods (pp. 154–175). London: Routledge.
van Leeuwen, T. (2006). Towards a semiotics of typography. Information Design Journal, 14(2), 139–155.
Cited by (4)
Cited by four other publications
Palmer-Silveira, Juan C. & Miguel F. Ruiz-Garrido
Johannessen, Christian Mosbæk, Mads Nedergård Qwist & Anders Glent Buch
2022. A quantitative framework for analyzing distinctive features of typography. Information Design Journal 27:3 ► pp. 278 ff.
Wong, May L-Y
This list is based on CrossRef data as of 11 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.