Emotions in multimodal texts

Multimodality has both challenged traditional text analysis strategies and offered a new scenario for the study of emotions in texts. In accessible translation, emotions are presented in different modes and thus intersemiosis is key to the success of the accessible translated text. The aim of this article is to study emotions in the accessible subtitling and audio description of texts that include affective elements from the perspective of the seven standards of textuality proposed by Beaugrande and Dressler (1981)Beaugrande, Robert de, and Wolfgang Ulrich Dressler. 1981. Introduction to Text Linguistics. 3rd ed. London: Longman..

Following a multimodal and intersemiotic approach, we first describe how emotions are represented in the multimodal lexical resource developed within the Lexemos project, and report a didactic experience carried out in an undergraduate Multimedia Translation module with 86 students. Second, we present how the standards of textuality are a solid foundation for decision making when translating emotionally-laden multimodal texts and adapting them to users with different needs and abilities. Third, we propose a workflow for the identification and analysis of emotions in multimodal materials that has been used for the teaching of audiovisual translation. The results show that the transmission of emotions and the transfer of meaning, functions and intentions are key to building a coherent text, improving user experience and allowing access to culture and knowledge in accessible translation practices