Understanding emotional responses to text: a psycholinguistic investigation of visual influences
Автор: Volkova Ya., Vashunina I.
Журнал: Вестник Волгоградского государственного университета. Серия 2: Языкознание @jvolsu-linguistics
Рубрика: Моделирование параметров текста для разработки систем искусственного интеллекта
Статья в выпуске: 5 т.23, 2024 года.
Бесплатный доступ
The paper explores the influence of visual elements on the emotional perception of textual content. Based on the experimental results, the authors evaluated how illustrations affected emotional responses to polycode/creolized texts. By using the semantic differential scales method, correlations between emotions and specific visual parameters were identified and analyzed. The results revealed how visual parameters of illustrations influence emotional responses to text in Russian, suggesting potential adjustments to emotional perception by manipulating these parameters: illustration style impacts recipient emotions; ambiguity and originality increase negative emotions, while realistic illustrations have varied effects. Additionally, the study investigated how variations in illustration style and content altered emotional interpretations of text, providing insights into the complex interplay between visual and verbal elements in communication. The findings suggest practical implications for educational material development, emphasizing the potential to adjust the emotional perception of textual content by manipulating visual characteristics. This research sheds light on the dynamics of emotional response to multimedia stimuli and offers valuable considerations for content creators seeking to optimize audience engagement and comprehension. It attempts to bridge the gap between visual perception, emotion processing, and linguistic communication, offering insights for both practical applications in NLP (Natural Language Processing) and theoretical advancements in cognitive sciences.
Polycode texts, creolization, emotion, emotional perception, verbal message, semantic differential scales method, text-image interaction
Короткий адрес: https://sciup.org/149147491
IDR: 149147491 | DOI: 10.15688/jvolsu2.2024.5.14
Список литературы Understanding emotional responses to text: a psycholinguistic investigation of visual influences
- Absattar A., Mambetova M., Zhubay O., 2022. The Potential of Emotive Language to Influence the Understanding of Textual Information in Media Coverage. Humanit Soc Sci Commun, vol. 9, no. 222. DOI: 10.1057/s41599-022-01232-2
- Babenko L.G., 2022. Alfavit emotsiy. Slovar-tezaurus emotivnoy leksiki [Alphabet of Emotions. Dictionary-Thesaurus of Emotive Vocabulary]. Yekaterinburg, Moscow, Kabinet. uchenyy Publ. 432 p.
- Chentsova-Dutton Y., 2020. Emotions in Cultural Dynamics. Emotion Review, vol. 12 (2), no. 47. DOI: 10.1177/1754073920921467
- Ionova S.V., 2022. Lingvistika emotsiy v kontekste sovremennykh nauchnykh issledovaniy [Linguistics of Emotions in the Context of Modern Scientific Research]. Izvestiiya VGPU, vol. 3, no. 166, pp. 221-226.
- Jackson J.C., Watts J., Henry T.R., List J.-M., Forkel R., Mucha P.J., Greenhill S.J., Gray R.D., Lindquist K.A., 2019. Emotion Semantics Show Both Cultural Variation and Universal Structure. Science, vol. 366, no. 6472, pp. 1517-1522.
- Krasavskiy N.A., 2008. Emotsionalnye kontsepty v nemetskoy i russkoy lingvokulturakh [Emotional Concepts in German and Russian Linguocultures]. Moscow, Gnozis Publ. 374 р.
- Kreolizovannyy tekst: Smyslovoe vospriyatie [Creolized Text: Semantic Perception], 2020. Moscow, In-t yazykoznaniya RAN. 206 p.
- Lindquist K.A., 2021. Language and Emotion: Introduction to the Special Issue. Affective Science, vol. 2, pp. 91-98. DOI: 10.1007/s42761-021-00049-7
- Lukyanova N.A., 2015. Ekspressivnaya leksika razgovornogo upotrebleniya v semanticheskom aspekte [Expressive Vocabulary of Colloquial Usage in the Semantic Aspect]. Vestnik Novosibirskogo gosudarstvennogo universiteta. Seriya: Istoriya, filologiya [Vestnik NSU. Series: History and Philology], vol. 14 (9), pp. 183-200.
- Metody borby so stressom: spravochnik rukovoditelya [Stress Management Methods. Manager’s Reference Book], 2022. Moscow, Saint Peterburg, BITOBE Publ. 92 р.
- Ponsonnet M., 2022. Emotional Language: A Brief History of Recent Research. Approaches to Language and Culture (Handbook). De Gruyter Mouton, pp. 307-335. (Anthropological Linguistics). DOI: 10.1515/9783110726626
- Pritzke S.E., Fenigsen J., Wilce J.M., eds., 2020. The Routledge Handbook of Language and Emotion. New York, Routledge. 454 p.
- Shakhovsky V.I., 2008. Lingvisticheskaya teoriya ėmotsiy [Linguistic Theory of Emotions]. Moscow, Gnozis Publ. 416 p.
- Shakhovsky V.I., 2010. Emotsii: dolingvistika, lingvistika, lingvokulturologiya [Emotions: Pre-Linguistics, Linguistics, Linguoculturology]. Moscow, Librokom Publ. 128 р.
- Vashunina I.V., 2007. Vzaimodeystvie vizualnykh i verbalnykh sostavlyayushchikh pri vospriyatii kreolizovannogo teksta [Interaction of Visual and Verbal Components in the Perception of Creolized Text]. Nizhniy Novgorod, NGPU. 412 р.
- Wierzbicka A., 2010. On Emotions and on Definitions: A Response to Izard. Emotion Review, vol. 2 (4), pp. 379-380. DOI: 10.1177/1754073910374664
- Wierzbicka A., Harkins J., 2001. Introduction. Harkins J., Wierzbicka A., eds. Emotions in Crosslinguistic Perspective. Berlin, Hawthorne, New York, Mouton de Gruyter, pp. 1-34.
- Zhelvis V.I., 2001. Pole brani: skvernoslovie kak sotsialnaya problema v yazykakh i kulturakh mira [Battlefield: Profanity as a Social Problem in the Languages and Cultures of the World]. Moscow, Nauch.-izd. tsentr “Ladomir”. 349 p.