The Data-driven Voice-Body in Performance: AI Voices as Materials, Mediators, and Gifts
(last edited: 2025)
author(s): JC Reus
This exposition is in progress and its share status is: visible to all.
Data-driven, realistic and identity-bearing AI voice technologies have been proliferating widely in recent years. Voice, a multiply embodied phenomenon situated within and across human bodies in space, is deeply disrupted by the disembodying tendencies of AI voice technologies and their processes of data creation and collection, resulting in the need for a re-evaluation of perceptual, cognitive and cultural factors. This paper addresses this need by synthesizing ideas from embodied cognition, voice studies, and material anthropology to analyze real-time, AI-mediated voice as a form of embodied cognition that is an enactive, intersubjective, extended, materially and socially distributed phenomenon. We examine AI-mediated voice through the case study of the live music performance iː ɡoʊ weɪ, which uses real-time AI voice transfer systems trained on carefully curated vocal datasets that represent diverse forms of vocal alterity relations. The live performance system integrates custom RAVE models within a SuperCollider environment, enabling dynamic real-time transformation of the performer's voice through a tactile control interface. This technical architecture facilitates immediate feedback loops between biological vocalization, AI processing, and auditory perception. The domain of audience perception becomes a key point of reflection, where the formation of new perceptions of voice and body is repeatedly challenged by the fluid voice-body gestalt of the performer, a process of donning vocal masks that modulate perceptual dissonances and resolutions. We further address the complex situation of voice AI through the concept of identity-bearing technologies, which leverages theories from voice studies, speech science, material anthropology and embodied cognition that address identity perception. Finally, we address the key ethical dilemmas of such systems, particularly as they relate to the problem of designing technologies that reproduce the illusion of a singular essential vocal identity. We respond to the problem of the representation of vocal bodies through a speculative framework of the vocal gift, analyzing how gift relationships are at play within the creation of the AI systems of iː ɡoʊ weɪ, and suggesting further directions for research into developing technological systems that honor gift relationships as a fundamental principle for ethical design of AI voice technologies.
Muestra de obra tesis doctoral
(last edited: 2023)
author(s): Federico Eisner Sagüés
This exposition is in progress and its share status is: visible to all.
La muestra despliega los resultados de la colaboración sonora con los poetas sonoros Luis Bravo y Pía Sommer durante el transcurso de mi investigación doctoral.
La muestra se estructura según los modos de colaboración, y los audios y videos se consideran los registros de una constelación de colaboraciones en torno a la las prácticas vocales, que excede a nuestras agencias humanas, incorporando también la agencia material de la tecnología y de nuestros círculos artísticos. En las intervenciones electroacústicas se trabajó a distancia sobre poemas sonoros previamente fijados por los poetas. Para las colaboraciones performáticas se incorporó el uso de instrumentos y efectos en vivo, y el trabajo a dos voces. Se trató de dos encuentros con cada poeta entre diciembre de 2019 y agosto de 2021 en Chile, Uruguay y España. La muestra incluye también las entrevistas realizadas a ambos poetas y las bitácoras de trabajo durante los encuentros. Por último, también se incluye una sección de archivo de la circulación artística y académica que ha tenido este trabajo.