The art of storytelling in the digital age: a multimodal perspective

Бесплатный доступ

Using Dan Brown’s Wild Symphony , Craig Silvey’s The Amber Amulet , and Jon McGregor’s In Winter the Sky as its case studies, this article attempts to explore a number of mechanisms and strategies contributing to the multimodal fiction construction and posing challenges for modern readers of all ages. The article proposes to examine multimodal resonance as a cognitive mechanism enhancing the emotional impact of multimodal stories on recipients and triggering the receptive mechanism of narrative empathy. Various semiotic resources, both free resources, such as photos, maps, and illustrations, and bound ones, including font types and typographical experiments, are analyzed from the standpoint of their role in fictional world creation. The article makes an original contribution to the Multimodal Stylistics Studies by hypothesizing the relevance of identifying two distinctive mechanisms of foregrounding: visual foregrounding as a range of formal ways to construct a multimodal text that focuses the reader’s attention with the help of free semiotic resources, and graphic foregrounding, which has bound semiotic resources at its heart. The findings of the research prove that it is the combination of elements of stylistic, cognitive and linguo-semiotic analyses that might provide a new and effective methodologyfor interpreting a multimodal literary text. The overall outcome testifies to the importance of further research into varied mechanisms of foregrounding as a complex phenomenon essential for our better understanding of the embodied character of reading.

Еще

Multimodal fiction, multimodal resonance, semiotic resources, foregrounding, narrative empathy, ludic modality

Короткий адрес: https://sciup.org/149141648

IDR: 149141648   |   DOI: 10.15688/jvolsu2.2022.6.9

Список литературы The art of storytelling in the digital age: a multimodal perspective

  • Abramo F.C., Gambino R., Pulvirenti, G., 2017. Cognitive Literary Anthropology and Neurohermeneutics. A Theoretical Proposal. Enthymema, no. XVIII, pp. 44-62.
  • Beavis C., 2013. Literary English and the Challenge of Multimodality. Changing English: Studies in Culture and Education, vol. 20, no. 3, pp. 241-252. DOI: 10.1080/1358684X.2013.816527
  • Chemodurova Z., 2019. The Mechanisms and Types of Foregrounding in Postmodernist Fiction. Haase Ch., Orlova N., eds. English Language Teaching: Through the Lens of Experience. Newcastle, Cambridge Scholars Publishing, pp. 277-295.
  • Chemodurova Z.M., 2021. Visual Foregrounding in Contemporary Fiction. Voprosy kognitivnoy lingvistiki, no. 2, pp. 5-15. DOI: 10.20916/1812-3228-2021-2-5-15
  • Decety J., Meyer M., 2008. From Emotion Resonance to Empathic Understanding: A Social Developmental Neuroscience Account. Development and Psychopathology, no. 20, pp. 1053-1080.
  • Fryer D.L., 2014. Reading Visual Narratives: Image Analysis of Children’s Picture Books. Linguistics and the Human Sciences, vol. 10.3, pp. 312-321. DOI: 10.1558/lhs.v10.3.19618
  • Gibbons A., 2009. “I contain Multitudes”: Narrative Multimodality and the Book That Bleeds. Page R., ed. New Perspectives on Narrative and Multimodality. London, Routledge, pp. 99-114.
  • Gibbons A., 2012. Multimodal Literature and Experimentation. Bray J., Gibbons A., McHale B., eds. Routledge Companion to Experimental Literature. London, New York, Routledge, pp. 420-434.
  • Hallet W., 2018. Reading Multimodal Fiction: A Methodological Approach. Anglistik: International Journal of English Studies, vol. 29, iss. 1, pp. 25-40.
  • Iriskhanova O.K., 2018. Fedya, dich! Ili o rezonanse v rechi i zhestakh [Fedya, dich’! On Resonance in Speech and Gestures]. Kognitivnye issledovaniya yazyka [The Cognitive Studies of the Language], iss. 33, pp. 598-604.
  • Jewitt C., ed., 2009. Handbook of Multimodal Analysis, London, Routledge. 340 p.
  • Keen S., 2006. A Theory of Narrative Empathy. Narrative, vol. 14, no. 3, pp. 207-236.
  • Koopman E.M., 2016. Effects of “Literariness” on Emotions and on Empathy and Reflection After Reading. Psychology of Aesthetics, Creativity, and the Arts, vol. 10, iss. 1, pp. 82-98. DOI: https://doi.org/10.1037/aca0000041
  • Kramer L., 1991. “Musical Narratology: A Theoretical Outline”. Indiana Theory Review, vol. 12, pp. 141-162.
  • Kress G., Van Leeuwen T., 2006. Reading Images: The Grammar of Visual Design. London, Routledge. 310 p.
  • Luke J., 2013. Writing the Visible Page: A MultimodalApproach to Graphic Devices in Literary Fiction. PhD by Creative Works. QUT ePrints. URL: https://eprints.qut.edu.au/63020/
  • McHale B., 1987. Postmodernist Fiction. London, New York, Routledge. 278 p.
  • Norgaard N., 2014. Multimodaly and Stylistics. Burke M., ed. The Routledge Handbook of Stylistics. London, New York, Routledge, pp. 471-485.
  • Painter C., Martin J.R., Unsworth L., 2013. Reading Visual Narratives: Image Analysis of Children’s Picture Books. Sheffield, Equinox. 181 p.
  • Ryan M.-L., 2002. Beyond Myth and Metaphor: Narrative in Digital Media. Poetics Today, vol. 23, iss. 4, pp. 581-609.
  • Ryan M.-L., 2004. Introduction. Ryan M.-L., ed. Narrative Across Media: The Languages of Storytelling. Lincoln, U of Nebraska, pp. 1-40.
  • Van Leeuwen T., 2004. Introducing Social Semiotics. London, New York, Routledge. 320 p.
  • Van Peer W., Hakemulder F., 2006. Foregrounding. Brown K., ed. Encyclopedia of Language & Linguistics. Vol. 4. Oxford, Elsevier, pp. 546-550.
  • Walton R., 1990. Mimesis as Make-Believe. London, Harvard Un. Press. 450 p.
  • Wolf W., 2009. Relations Between Literature and Music in the Context of a General Typology of Intermediality. Comparative Literature: Sharing Knowledges for Preserving Cultural Diversity. Vol. 1. URL: https://www.eolss.net/sample-chapters/c04/E6-87-02-02.pdf
Еще
Статья научная