In Sync With A Machine
(2026)
author(s): Ilja Mirsky, Leonid Berov, Gunter Loesel
published in: ArteActa – Journal for Performing Arts and Artistic Research
This paper delves into the dynamics and dramaturgical specifications of ANA, a theatrical installation engineered for co-creating narratives in a dialogic process with individual users. ANA embodies a collaborative storytelling environment that is used to communicate narrative and emotional information through multiple modalities, thereby bringing into focus an unexpectedly human essence in a human-machine interaction. Integrating GPT-4, emotion-recognition algorithms and a simulation of its own affective state, ANA engages users in a 10-minute interaction, fostering an immersive narrative exchange where the affective dimension of collaborative storytelling takes precedence. This paper explores the specific challenges of prompt design in this setting, focusing on the concept of emotional attuning, the feeling of being “in sync” with a machine throughout the interaction. Through an analytical lens encompassing cognitive science, philosophy of mind, and prompting techniques, the authors describe and reflect practices of employing multimodal sensorial data such as emotion recognition, and dramatic considerations, into the process of designing prompts. They also describe and reflect on their attempts to establish a form of meta-communication with the machine about the emotional aspects of the experience. By focusing on dramaturgical and improvisational strategies, this paper underscores the pivotal significance of emotional attunement and multimodal communication in fostering intimate technological engagement.
