Research & Development


Interactive Audio Augmented Reality (AAR) facilitates collaborative storytelling and human interaction in participatory performance. Spatial audio enhances the auditory environment and supports real-time control of media content and the experience. Nevertheless, AAR applied to interactive performance practices remains under-explored. This study examines how audio human-computer interaction can prompt and support actions, and how AAR can contribute to developing new kinds of interactions in participatory performance.

This study investigates an AAR participatory performance based on the theatre and performance practice by theatre-maker Augusto Boal. It draws from aspects of multi-player audio-only games and interactive storytelling. A user experience study of the performance shows that people are engaged with interactive content and interact and navigate within the spatial audio content using their whole body. Asymmetric audio cues, playing distinctive content for each participant, prompt verbal and non-verbal communication. The performative aspect was well received and participants took on roles and responsibilities within their group during the experience.

This paper was written primarily by Valentin Bauer and Anna Nagele and describes work carried out during an internship at BBC R&D.

The full list of authors is Valentin Bauer (QMUL), Anna Nagele (QMUL), Joshua D. Reiss (QMUL), Patrick G. T. Healey (QMUL), Chris Baume (BBC R&D), Tim Cowlishaw (BBC R&D), Henry Cooke (BBC R&D), and Chris Pike (BBC R&D).

This is an open-access article, published by Frontiers in Virtual Reality and distributed under the terms of the Creative Commons Attribution License (CC BY).

This publication is part of the Internet Research and Future Services section

This publication is part of the Immersive and Interactive Content section