We employ augmented reality (AR) glasses combined with automated speech recognition, and optionally, our bespoke system based on large language models (LLMs), to enable novice (and challenge veteran) improvisers to join us in improvisational theatre scenes. Our AR+LLM improv system has been validated in 51 live theatre performances and 3 workshops. This interactive demo session is an applied improvisation workshop open to participants without theatre experience, and is facilitated by two professional performers who help “get you out of your head”.

Language models are increasingly attracting interest from writers. However, such models lack long-range semantic coherence, limiting their usefulness for longform creative writing. We address this limitation by applying language models hierarchically, in a system we call Dramatron. By building structural context via prompt chaining, Dramatron can generate coherent scripts and screenplays complete with title, characters, story beats, location descriptions, and dialogue. We illustrate Dramatron’s usefulness as an interactive co-creative system with a user study of 15 theatre and film industry professionals. Participants co-wrote theatre scripts and screenplays with Dramatron and engaged in open-ended interviews. We report reflections both from our interviewees and from independent reviewers who critiqued performances of several of the scripts to illustrate how both Dramatron and hierarchical text generation could be useful for human-machine co-creativity. Finally, we discuss the suitability of Dramatron for co-creativity, ethical considerations—including plagiarism and bias—and participatory models for the design and deployment of such tools.

Abstract In this work, we present a perspective on the role machine intelligence can play in supporting human abilities. In particular, we consider research in rehabilitation technologies such as prosthetic devices, as this domain requires tight coupling between human and machine. Taking an agent-based view of such devices, we propose that human–machine collaborations have a capacity to perform tasks which is a result of the combined agency of the human and the machine. We introduce communicative capital as a resource developed by a human and a machine working together in ongoing interactions. Development of this resource enables the partnership to eventually perform tasks at a capacity greater than either individual could achieve alone. We then examine the benefits and challenges of increasing the agency of prostheses by surveying literature which demonstrates that building communicative resources enables more complex, task-directed interactions. The viewpoint developed in this article extends current thinking on how best to support the functional use of increasingly complex prostheses, and establishes insight toward creating more fruitful interactions between humans and supportive, assistive, and augmentative technologies.

Performers acutely need but lack tools to remotely rehearse and create live theatre, particularly due to global restrictions on social interactions during the Covid-19 pandemic. No studies, however, have heretofore examined how remote video-collaboration affects performance. This paper presents the findings of a field study with 16 domain experts over six weeks investigating how tele-immersion affects the rehearsal and performance of improvisational theatre. To conduct the study, an original media server was developed for co-locating remote performers into shared virtual 3D environments which were accessed through popular video conferencing software. The results of this qualitative study indicate that tele-immersive environments uniquely provide performers with a strong sense of co- presence, feelings of physical connection, and an increased ability to enter the social-flow states required for improvisational theatre. Based on our observations, we put forward design recommendations for video collaboration tools tailored to the unique demands of live performance.

Improvisational theatre (improv) has been proposed as a grand challenge for general artificial intelligence (AI)~\citemartin2016improvisational. Current state-of-the-art conversational intelligence models lack proper grounding, language understanding, and generate meaningless meandering responses~\citedziri2018augmenting. Utilizing them as improvised comedy partners (improvisors) is doomed to fail - curiously, this limitation makes their use particularly appealing. Improv theatre celebrates risk taking and failure by inviting performers to express themselves without hesitation or fear of being judged~\citejohnstone1979impro. Our installation is an interactive improv workshop for a group of interested participants, culminating in a live public performance. Attendees are invited to observe and interact with AI-based improvisational theatre technology. The workshop is facilitated by two improv theatre professionals with a combined 30 years of experience in teaching, training, and touring. The performance features various AI tools for augmented creativity.