Exposition

In Sync With A Machine (2026)

Ilja Mirsky, Leonid Berov, Gunter Loesel

About this exposition

This paper delves into the dynamics and dramaturgical specifications of ANA, a theatrical installation engineered for co-creating narratives in a dialogic process with individual users. ANA embodies a collaborative storytelling environment that is used to communicate narrative and emotional information through multiple modalities, thereby bringing into focus an unexpectedly human essence in a human-machine interaction. Integrating GPT-4, emotion-recognition algorithms and a simulation of its own affective state, ANA engages users in a 10-minute interaction, fostering an immersive narrative exchange where the affective dimension of collaborative storytelling takes precedence. This paper explores the specific challenges of prompt design in this setting, focusing on the concept of emotional attuning, the feeling of being “in sync” with a machine throughout the interaction. Through an analytical lens encompassing cognitive science, philosophy of mind, and prompting techniques, the authors describe and reflect practices of employing multimodal sensorial data such as emotion recognition, and dramatic considerations, into the process of designing prompts. They also describe and reflect on their attempts to establish a form of meta-communication with the machine about the emotional aspects of the experience. By focusing on dramaturgical and improvisational strategies, this paper underscores the pivotal significance of emotional attunement and multimodal communication in fostering intimate technological engagement.
typeresearch exposition
keywordsartificial intelligence, artistic processes, theater installation, prompt engineering, prompting, improvisational theatre, affect theory, digital artistic research, large language model, storytelling, human-machine-interaction, installation art
date15/09/2024
published28/01/2026
last modified28/01/2026
statuspublished
affiliationZurich University of the Arts
copyrightIlja Mirsky, Gunter Lösel, Leonid Berov
licenseCC BY-NC-ND
languageEnglish
urlhttps://www.researchcatalogue.net/view/3009623/3009622
doihttps://doi.org/10.22501/artact.3009623
published inArteActa – Journal for Performing Arts and Artistic Research
portal issue14. ArteActa 14/2025
external linkhttps://www.residenztheater.de/ana


Comments are only available for registered users.