Zum Hauptinhalt springen


Masterclass John Bateman

Introduction to Multimodal Linguistics

Wir dürfen kurzfristig auf einen Vortrag von JohnBateman, Universität Bremen, hinweisen, der gleichzeitig im Rahmen der Masterclasses on Multimodality angeboten wird. In der Vorlesungsreihe „English-Speaking Cultures: Topics, Theories and Methods wird JohnBateman einen Überblick über und eine Einführung in den Bereich Multimodale Linguistik geben.

Prof. JohnBateman
Mittwoch, 28. November 2018
GW1 HS H1010

Masterclass Dušan Stamenković

Video Games

Wir freuen uns, eine weitere Masterclass zum Thema Multimodalität ankündigen zu dürfen, zu der wir alle interessierten Studierenden und KollegInnen einladen möchten:


Dušan Stamenković, University of Niš, Serbia

am 29. November 2018
um 14.15 Uhr
in GW2 B3009

The present talk represents an attempt to link the approach that combines aspects of Bogost’s procedural rhetoric (2007) and Fairclough’s CDA theoretical positions (1995, 2003) and focuses on phenomena such as the rule-based discourse, meta-rules, remediation and invisibilization (Popović and Stamenković, in press) with the approach to first-person, real-time video games proposed in Multimodality: Foundations, Research, Analysis – A Problem-Oriented Introduction (Bateman, Wildfeuer and Hiippala 2017). By pulling gameworld and interface canvases apart and identifying semiotic modes mobilised in them for the purpose of establishing a game’s procedurality, we are likely to reveal the role of different modes in gaming aspects related to meta-rules, remediation and invisibilization. Drawing on such theoretical background, the talk will employ several exemplar screenshots coming from war-related video games to depict the games’ procedurality and the impact that different elements in their canvases have on the functioning of procedurality.

Bateman, John A., Janina Wildfeuer and Tuomo Hiippala. 2017. Multimodality: Foundations, Research, Analysis – A Problem-Oriented Introduction. Berlin and New York: De Gruyter.

Bogost, Ian. 2007.Persuasive Games: The Expressive Power of Videogames. Cambridge, MA: The MIT Press.

Fairclough, Norman. 1995. Critical Discourse Analysis: The Critical Study of Language. London and New York: Longman.

Fairclough, Norman. 2003. Analysing Discourse.New York: Routledge.

Popović, Mladen and Dušan Stamenković. In press. Critical discourse analysis, procedurality and persuasion in video games. In: Lopičić, V. and B. Mišić Ilić (eds). Language, Literature, Theory. Niš: Faculty of Philosophy.

Masterclass Djonov/Tseng

Transmedial Narratives | 11. Oktober, 16.15

Wir freuen uns, eine weitere Masterclass zum Thema Multimodalität ankündigen zu dürfen, zu der wir gleich zu Beginn des neuen Semesters alle interessierten Studierendem und KollegInnen einladen möchten:


Emilia Djoniv & Chiao-I Tseng

am 11. Oktober 2018
um 16.15 Uhr
in GW2 A3570

A large body of research has established the need for systematic investigations into learners’ ever more pervasive engagement with new technologies and their competence in accessing, interpreting and authoring multimedia texts (cf. Buckingham 2003, Finch & Arrow 2017; Marsh et al. 2017). As a step towards addressing this need, we consider the question of how engagement with different media can be effectively harnessed for teaching multimodal literacy. Ourpresentationopens with a quick overview of definitions of and approaches to multimodal literacy. Inspired by studies that recognisethe value of studying ‘transmedialnarratives’ for both multimodality (e.g. Tseng & Bateman 2018) and critical multiliteracies education (e.g. Unsworth 2014), we then examinethe potential of engaging with adaptations of the same narrative in different media to build on young children’s awareness of the affordances of different media and the modes they support. Specifically, we integrate:

  • selected results of a study in which 16 dyads of university-educated mothers and their 4-5-year-old children, each read the narrative The Fantastic Flying Books of Mr. Morris Lessmoreas an interactive picture book app (MoonbotStudios 2011) and as a traditional-format picture book (Joyce 2012), and
  • the systematic, comparative multimodal analysis of action and event development (based on methods presented in Tseng 2013, 2018) in three versions of that narrative: the award-winning animated short film (Joyce 2011), the book app and traditional-format book.

We argue that comparing basic aspects of the materiality (e.g. presence or absence of interactive hotspots) and semantics (e.g. constructions of events; depictions of and interactions between characters) of adaptations of the same narrative in different media is a method that can help young children enhance their existing multimodal awareness, and support teachers in both evaluating transmedia narratives and later adopting and introducing, in age-appropriate ways, a metalanguage for discussing more complex semantic systems (e.g. ‘focalisation’– see Unsworth, 2014).

Buckingham, D. (2003).Media Education: Literacy, Learning and Contemporary Culture. Cambridge, UK/ Malden, MA, USA: Polity Press.

Finch, B., & Arrow, A. W. (2017). Digital technologies in the literate lives of young children. In C. J. McLachlan & A. W. Arrow (Eds.), Literacy in the Early Years: Reflections on International Research and Practice(pp. 221-238). Singapore: Springer Singapore.

Joyce, W. (Producer), & Joyce, W., & Oldenburg, B. (Directors). (2011). The Fantastic Flying Books of Mr Morris Lessmore[Motion Picture]. USA: Moonbot Studios.

Joyce, W. (2012). The Fantastic Flying Books of Mr. Morris Lessmore (Illustrations by William Joyce and Joe Bluhm). New York: Moonbot Books.

Marsh, J., Hannon, P., Lewis, M., & Ritchie, L. (2017). Young children’s initiation into family literacy practices in the digital age. Journal of Early Childhood Research, 15(1), 47-60. doi:doi:10.1177/1476718X15582095

Moonbot Studios (2011). The Fantastic Flying Books of Mr Morris Lessmore(Version 1.4). [Mobile Application Software].

Tseng, C.-I. (2013). Analysing characters‘ interactions in filmic text: a functional semiotic approach. Social Semiotics, 23(5), 587-605. doi:10.1080/10350330.2012.752158

Tseng, C.-I. (2018). Unravelling the myth of multiple endings and the narrative labyrinth in Mr. Nobody(2010). In S. Zhao, E. Djonov, A. Björkvall & M. Boeriis (Eds.), Advancing multimodal and critical discourse studies: Interdisciplinary research inspired by Theo Van Leeuwen’s social semiotics(pp. 131-145). London/New York: Routledge.

Tseng, C., & Bateman, J. A. (2018). Cohesion in comics and graphic novels: an empirical comparative approach to transmedia adaptation in City of Glass. Adaptation.
Unsworth, L. (2014). Point of view in picture books and animated film adaptations: Informing critical multimodal comprehension and composition pedagogy. In E. Djonov & S. Zhao (Eds.), Critical Multimodal Studies of Popular Discourse(pp. 202-216). London/New York: Routledge.