Multimodality in reports on communication activities Cover Image

Multimodalność w relacjach z działań komunikacyjnych
Multimodality in reports on communication activities

Author(s): Celina Heliasz-Nowosielska
Subject(s): Sociolinguistics, Descriptive linguistics, Theory of Communication, Rhetoric, Stylistics
Published by: Polskie Towarzystwo Językoznawcze
Keywords: reported speech; communication activities; multimodality; verbal and nonverbal communication; gestures;

Summary/Abstract: The article presents selected results of the pilot part of an experimental study on reporting multimodal communication activities by adult speakers of Polish. The starting point of the experiment was theoretical and empirical research on the involvement of various modalities in communication activities, in addition to words, intonation, prosody, facial expressions, gestures, movements of the whole body and its parts (Austin 1962; Kendon 1994, 2000, 2004; Poggi 2007; Hellbernd & Sammler 2016). In order to obtain data for the analysis, 23 fragments of documentary films from the collection of the Archives of the Film School in Łódź were presented to 101 adults, who differed in terms of age, sex and education. The participants of the experiment were asked to report on what the characters were doing. The result of the study was a database that included recordings of both the communication activities and the reports on them. The pilot part of the study covered the qualitative and quantitative analysis of 10 fragments of films. We analysed the meaning and reference of the vocabulary used by the participants to report on the multimodal communication activities observed in the films, the frequency of expressions used in the reports, as well as the discrepancies in the reports. The analysis showed that if a given turn was a composition or a sequence of activities of different modalities, the speaker could report on each of these activities separately or use a single qualifier to describe a whole group of activities. Such qualifiers can be both the names of performative acts and the names of actions of any specific modality. If the conversation changes in terms of modality, then it can be perceived by individual observers through the lens of the various episodes that make up the conversation. Certain actions are sometimes more often taken into account or omitted, which shows differences in the level of importance that speakers attach to different types of activities.

  • Issue Year: LXXVII/2021
  • Issue No: 77
  • Page Range: 139-152
  • Page Count: 14
  • Language: Polish