There is a growing interest in interactive visuals for dance performance. Recent research has identified potential in using interactive visuals to convey to the audience otherwise non-visible elements of performances. Informed by soma design, and with a co-design perspective, we aim to make apparent non-visible bodily aspects of dancers. We propose to design interactive visuals from body maps, following two approaches – Machine Learning and Composite Animation. We conducted a multi-stage study involving 12 dancers. We present and discuss the results of our evaluations, confirming that both prototypes were successful in addressing our aim, with some limitations. We discuss our two approaches, different uses and actors in different stages, tensions between research and dance creation, and potential applications. Our main contributions are the two approaches for designing interactive visuals from body maps and their analysis. These are materialized in two software systems released as open-source and in their design framework descriptions.

There has been a growing interest in interactive visuals in contemporary dance performances. These visuals often rely on embodied interaction techniques, such as motion capture or biosignal sensors. However, there is a lack of research into how audience members experience these interactive visuals, and how to enhance that experience. We conducted an audience study, involving four different dance performances. Each of the performances explored a different approach for interaction involving visuals. We collected data from audience members, regarding their experience of the performances, using questionnaires and interviews. The analysis of this data allows us to identify implications for design: balancing trade-offs within a mapping clarity spectrum; connecting layers; visuals as co-creative mediator; defined territory and individuality of visuals; exploration of perspective shift and abstract fragmentation. We argue that these considerations are relevant for designers of systems visualizing embodied interaction, not just for dance, but also for other related applications.

This paper presents an interactive media installation that aims at providing users with the experience to sing like an opera singer from the 19th century. We designed a set of tangible and body-related interaction and feedback techniques and developed a singing voice synthesizer system that is controlled by the user's mouth shapes and gestures. This musical interface allows users to perform an aria without real singing. We adapted techniques from 3D body tracking, face recognition, singing voice synthesis, 3D rendering and tangible interaction to integrate them into an interactive musical interface.