We employ augmented reality (AR) glasses combined with automated speech recognition, and optionally, our bespoke system based on large language models (LLMs), to enable novice (and challenge veteran) improvisers to join us in improvisational theatre scenes. Our AR+LLM improv system has been validated in 51 live theatre performances and 3 workshops. This interactive demo session is an applied improvisation workshop open to participants without theatre experience, and is facilitated by two professional performers who help “get you out of your head”.

Our work explores how audiences perceive and engage with remote music events. The shift to digital platforms has transformed the live music experience, leading to the rise of remote music performances. Following the COVID-19 pandemic, platforms such as Twitch have been repurposed and surged in popularity as meaningful outlets for live music dissemination. Concurrently, novel platforms specifically crafted for music events have begun to emerge. Understanding the preferences and challenges of remote music audiences is crucial because it guides the development of platforms that effectively answer varied user needs, which could enhance overall engagement and shape the future of music consumption. For this, we employed a qualitative multi-method approach, including a survey, interviews, and event observations, to start mapping the design space of remote music performances and capture a wide spectrum of audience perspectives. Our findings reveal audience engagement patterns in remote music events across different digital platforms, highlighting unmet needs, desires as well as opportunities for future HCI work in this area.

This paper examines the design of technology for remote music performances, from the perspective of their audiences. In this process, we involved a total of 104 participants across the different stages of our project. Initially, we collected qualitative data from remote audiences using several methods, including surveys, interviews, and observations. Through the thematic analysis of this data, we identified four design dimensions consisting of 17 key elements that illustrate what audiences value in remote music spaces. We applied these insights in a participatory design workshop with diverse stakeholders, contributing to the development of speculative design ideas in this field. The paper concludes by presenting key design insights for future technology advancements in remote music performances. The research contributes to the evolving design space of remote music performances, offering valuable perspectives for researchers, designers, and industry stakeholders.

The acoustic and visual experiences of musicians in the spaces they perform in are complex and organic in nature, entailing a continuous interaction with the environment. With this project, we leverage the power of Virtual Reality (VR) to support musicians in their creative practice by transporting them to novel sonic and visual worlds. For this, we developed a musician-centred VR system, featuring various acoustic and visual virtual environments, VR Rehearse & Perform, based on design requirements gathered with musicians and performance experts. To investigate how VR can be designed to support music-makers in their creative musical practice, we performed iterative tests with 19 musicians followed by semi-structured interviews. Our findings suggest that VR has the potential to support different aspects of the creative musical practice, such as rehearsing, performing and improvising. Our research provides insights and inspirations toward designing musician-centred VR experiences for various musical activities.

Performers acutely need but lack tools to remotely rehearse and create live theatre, particularly due to global restrictions on social interactions during the Covid-19 pandemic. No studies, however, have heretofore examined how remote video-collaboration affects performance. This paper presents the findings of a field study with 16 domain experts over six weeks investigating how tele-immersion affects the rehearsal and performance of improvisational theatre. To conduct the study, an original media server was developed for co-locating remote performers into shared virtual 3D environments which were accessed through popular video conferencing software. The results of this qualitative study indicate that tele-immersive environments uniquely provide performers with a strong sense of co- presence, feelings of physical connection, and an increased ability to enter the social-flow states required for improvisational theatre. Based on our observations, we put forward design recommendations for video collaboration tools tailored to the unique demands of live performance.