A semiotic approach to visitor interaction, participation and perspective in digital arts

Birgit Huemer

pp. 144-147

in: Roy Ascott, Gerald Bast, Wolfgang Fiel, Margarete Jahrmann, Ruth Schnell (eds), New realities, Berlin, Springer, 2009

Abstract

This paper will focus on the concept of ineractivity, visitor perspective and representations of virtual or illusive space by using a functional semiotic approach that considers different modes of communication (e.g. language, image, sound, etc.) and their intermodal relations. The multimodal framework for the analysis and interpretation of digital art works, which are increasingly generated multimodally, is based on the systemic functional language-theory proposed by Halliday (1978, 1994). This approach has inspired work in expanding the functional model for analysing visual design (Kress & van Leeuwen 1996), music and sound (van Leeuwen 1999), as well as visual arts, sculpture and architecture (O'Toole 1994).