For citation:
Dubrovskaya T. V. Multimodal аnalysis in genre studies: Semiotics of the tourist booklet. Speech Genres, 2022, vol. 17, iss. 4 (36), pp. 250-261. DOI: 10.18500/2311-0740-2022-17-4-36-250-261, EDN: TMQQSM
Multimodal аnalysis in genre studies: Semiotics of the tourist booklet
The paper discusses the complex genre of tourist booklet as a fixed type of multimodal text that serves in a communicative situation of promoting a tourist product. This genre is a semiotically complex phenomenon, which conveys information through different semiotic systems. The methodological issues are posed as to a perspective model of genre analysis that would take into account the multimodal nature of genres. The author points to major hindrances that an analyst faces when doing multimodal analysis. The study focuses on discovering mechanisms of the interplay between verbal and visual components on semantic and formal levels, as well as showing how the elements of multimodal analysis can be targeted at various genre parameters. The booklets (85 items) for the study were collected in 2007–2019 in Australia, Great Britain, Germany, Poland, Russia and other countries. Methodologically, the paper draws on speech genre theory, semiotics, critical discourse analysis, and multimodal analysis. The claims are advanced that the tourist booklet has both obligatory and optional features, the visual component being obligatory. It is revealed that the colours of visuals can have factual and modal meanings embedded in them; photos convey precedent meanings; while using different semiotic codes, visual and verbal elements join the convergence relations and, thus, provide for genre coherence. The complex genre includes intertextual links between genres in its structure. These links may be of cross-code nature, since they are established between the elements of different semiotic systems, verbal and non-verbal. The conclusion is drawn that a consistent analytical model for multimodal genres has to be designed.
- Bakhtin M. M. The problem of speech genres. In: Estetika slovesnogo tvorchestva. 2-e izd. [Toward the aesthetics of the word. 2nd ed.]. Moscow, Iskusstvo Publ., 1996, pp. 250–296 (in Russian).
- Barthes R. Izbrannyje raboty: Semiotika. Poetika [Selected papers: Semiotics. Poetics]. Moscow, Progress Publ., 1989. 616 p. (in Russian).
- Bateman J. A. Multimodality and genre: A foundation for the systematic analysis of multimodal documents. New York, Palgrave Macmillan, 2008. 312 p. (in Russian).
- Dubrovskaya T. V. “Only Mother and Geländewagen 5.5 Deserve Love”: Busters’ Lyrics as a Genre of the Youth Internet Discourse. Speech Genres, 2019, no. 1 (21), pp. 56–65 (in Russian). https://doi.org/10.18500/23110740-2019-1-21-56-65
- Dubrovskaya T. V. The tourist booklet as a genre of professional discourse: Interaction with the customer. Training, Language and Culture, 2021, vol. 5, iss. 2, pp. 37–50.
- Fedosyuk M. Y. Unsolved problems in speech genre theory. Voprosy yazykoznanija [Issues in Language Studies], 1997, no. 5, pp. 102–120 (in Russian).
- Ginijatova E. V. Reklama v kommunikatsionnom protsesse [Advertisement in communication process]: teaching manual. Tomsk, Tomsk Polytechnic University Publ., 2009. 79 p. (in Russian).
- Goroshko E. I., Pavlova L. V. Text transformation caused by genre system of social media services in the Internet communicative space (based on English language political websites). Speech Genres, 2015, no. 1 (11), pp. 122–136 (in Russian).
- Kibrik A. A. Russian multichannel discourse. Part 1. Posing the problem. Psychological Journal, 2018, vol. 39, no. 1, pp. 70–80 (in Russian).
- Kozhemyakin E. A. Multimodal discourse: Methodological challenges. Modern developments in linguistics and language teaching: 3rd International conference proceedings: in 2 volumes. T. V. Dubrovskaya, ed. Vol. I. Methods in linguistics. Penza, Penza State University, 2019, pp. 19–24 (in Russian).
- Kress G., van Leeuwen T. Colour as a semiotic mode: Notes for a grammar of colour. Visual Communication, 2002, no. 1 (3), pp. 343–368.
- Kress G. Multimodality: A social semiotic approach to contemporary communication. London, New York, Routledge, 2010. 236 p.
- Krysin L. P. Tolkovyj slovar inoyazychnukh slov [Explanatory dictionary of foreign words]. Moscow, Eksmo Publ., 2005. 944 p. (in Russian).
- Norris S. Analyzing multimodal interaction: A methodological framework. New York, London, Routledge, 2004. 177 p.
- O’Halloran K. L. Introduction. In: O’Halloran K. L., ed. Multimodal discourse analysis. Systemic-functional perspectives. London, New York, Continuum, 2004, pp. 1–7.
- Peirce Ch. S. Izbrannyje filosofskije proizvedenija [Selected papers in phylosophy]. Moscow, Logos Publ., 2000. 448 p. (in Russian).
- Pokrovskaya E. A., Dudkina N. V., Kudinova E. V. Rechevyje zhanry v dialoge kultur [Speech genres in the dialogue of cultures]. Rostov-on-Don, Foundation Publ., 2011. 200 p. (in Russian).
- Prozorov V. V. Vlast i svoboda zhurnalistiki [Power and freedom of journalism]. Moscow, Flinta, Nauka Publ., 2012. 240 p. (in Russian).
- Ryabtseva E. G. Visual information in texts of advertising discourse. Zhanry i tipy teksta v nauchnom i medijnom diskurse. Vyp. 16 [Genres and text types in scientific and media discourse, iss. 16]. Oryol, Gorizont Publ., 2019, pp. 76–86 (in Russian).
- Schurina Y. V. Genre individuality of Instagram social net. Speech Genres, 2016, no. 1(13), pp. 156–168 (in Russian). https://doi.org/10.18500/2311-0740-2016-113-156-168
- Shmelyova T. V. Genre in the modern media. In: Shmelyova T. V. Medijnoe rechevedenije: sbornik statei [Media genre studies: collection of articles]. Available at: http://www.medialing.spbu.ru/upload/files/file_1394527055_0816.pdf (accessed 12 ay 2021).
- Shmelyova T. V. Speech genre model. Zhanry rechi: sb. nauch. st. [Speech Genres: coll. of sci. arts]. Saratov, GosUNTs “Kolledzh”, 1997, pp. 88–98 (in Russian).
- Zagidullina M. V. Language as a “semiotic resource” in a competitive environment: inevitable transdisciplinarity in modern communication studies. In: I. P. Amzarakov, ed. From research differentiation to trandisciplinarity: All-Russia conference to mark A. von Gumboldt 250th anniversary. Abakan, Khakass State University named after N. F. Katanov, 2019, pp. 21–26 (in Russian).
- Zagidullina M. V. Multimodality: The terminological issue. Sign: Problematic Area of Media Education, 2019, no. 1 (31), pp. 181–188 (in Russian).