Exposition

Between Data and Breath: Machine Learning, Musical Embodiment and the Emergence of Voice (last edited: 2025)

Jonathan Reus
open exposition

About this exposition

From vocal deepfakes to artificial voice actors and pop star avatars, data-driven machine learning has intensified embodied, musical, and social complexities of voice. While disembodiment and decontextualisation of voice have been musical concerns since the invention of sound recording, AI voice synthesis accelerates these processes and adds new perceptual, cognitive, and social layers. Many ontologies from voice studies imagine voice as resisting fixity, yet in today’s technological climate this resistance may be losing its ontological imperative. Voice is in transformation - possibly crisis - requiring both curiosity and care in paradoxical tension. These changes also unfold within a technological arms race for innovation, profit, and global AI supremacy. Artists are not only early adopters, but experimentalists and bards who participate in the narratives around AI and vocality. This thesis evaluates the changing vocal condition through first-person artistic research with AI voice technologies, exploring their poetics and potentials in three artworks created between 2021–2025. In Search of Good Ancestors / Ahnen in Arbeit was a year-long generative radio broadcast exploring machine learning as a intergenerational vocal memory. iː ɡoʊ weɪ is a hybrid extended voice performance practice using real-time voice transfer to unravel vocal identity on stage. DadaSets investigates the invisibilized vocal labour of AI voice through collaborations with artists, new scoring systems, the absurdist dataset-making performance Bla Blavatar vs Jaap Blonk, and the invention of the voice synthesis instrument Tungnaá. These works are analyzed through an interdisciplinary lens: experimental vocal traditions and the embodied musical-technological ethos of STEIM, alongside philosophies of voice, cognitive neuroscience, and material anthropology; while predictive coding theory frames compositional notions of uncanny, pathological and convivial technologisations of voice. Voice data emerges as paradoxical - both disembodied and relational, material and emergent, gift and commodity - functioning as the basis for musical animacy and collaboration within a rapidly changing socio-technical landscape.
typeresearch exposition
keywordsvoice and live electronics, voice studies, critical technical practice, Artificial Intelligence (AI), Vocal Music, probabilistic models, musicking, convivial technologies of voice, archival art practice, predictive processing, emergence, embodiment, live music, Live-electronics, radio art, long durational composition, identity perception, data ethics, performance studies, experimental music, experimental musical instruments, software, digital musical instruments, collaborative voice, collective data creation, data-driven
date15/09/2025
last modified15/10/2025
statusin progress
share statuspublic
affiliationUniversity of Sussex. School of Media, Arts and Humanities
copyrightJonathan Reus
licenseAll rights reserved
languageEnglish
urlhttps://www.researchcatalogue.net/view/3866796/3866797


Copyrights

nameCurly Bracket Right
copyrightJonathan Reus
licenseAll rights reserved
usagespicture, picture, picture, picture
nameCURLY-RIGHT-OPEN
copyrightJonathan Reus
licenseAll rights reserved
usagespicture, picture
name250812-igouwei--250815-morph-export - copy
copyrightJonathan Reus
licenseAll rights reserved
usagesvideo
nameAIMC-2023-igouwei-2otherspecies - copy
copyrightJonathan Reus
licenseAll rights reserved
usagesvideo
nameigouwei-signal-flow-diagram.drawio - copy
copyrightJonathan Reus
licenseAll rights reserved
usagespicture
nameigouwei-score-interface-2 - copy
copyrightJonathan Reus
licenseAll rights reserved
usagespicture
nameigouwei-interface-2 - copy
copyrightJonathan Reus
licenseAll rights reserved
usagespicture
namejvox95x1_04 - copy
copyrightJonathan Reus
licenseAll rights reserved
usagesaudio
nameblonk2_95x1_04 - copy
copyrightJonathan Reus
licenseAll rights reserved
usagesaudio
nameanimal2x2_11 - copy
copyrightJonathan Reus
licenseAll rights reserved
usagesaudio
namechorala2x2_16 - copy
copyrightJonathan Reus
licenseAll rights reserved
usagesaudio
nameacry03vae10x2_21 - copy
copyrightJonathan Reus
licenseAll rights reserved
usagesaudio
nameDadasets S+T+ARTS AIR Residency Video 1080p
copyrightJonathan Reus
licenseAll rights reserved
usagesvideo
nameISOGA Web Portal 2022-03-13 18-11-27
copyrightJonathan Reus
licenseAll rights reserved
usagesvideo
nameSeeking Truth Seeking (Broadcast Version)
copyrightJonathan Reus
licenseAll rights reserved
usagesaudio
nameSeeking Truth Seeking Radio Screenshot
copyrightJonathan Reus
licenseAll rights reserved
usagespicture
nameISOGA WEB PORTAL 2023-03-06 14-26-46
copyrightJonathan Reus
licenseAll rights reserved
usagesvideo
nameHIIT Brave New World 2.0 2110-Staircase-Hello-Lucy
copyrightHIIT
licenseAll rights reserved
usagesvideo
namewordless-audience1
copyrightJonathan Reus
licenseAll rights reserved
usagespicture
nameBla Blavatar vs Jaap Blonk Teaser Video
copyrightJonathan Reus
licenseAll rights reserved
usagesvideo
nameTungnaá NIME 2024 Demo Video
copyrightJonathan Reus
licenseAll rights reserved
usagesvideo
nameTungnaá Interspeech 2025 Demo Video
copyrightJonathan Reus
licenseAll rights reserved
usagesvideo
nameFiber Festival 2024 Context Program Day 2
copyrightJonathan Reus
licenseAll rights reserved
usagespicture
nameCarolyn McGettigan ElevenLabs P11-19_E1_
copyrightCarolyn McGettigan
licenseAll rights reserved
usagesaudio, audio
nameCarolyn McGettigan Elevenlabs p233_clone_audiobook19_1
copyrightCarolyn McGettigan
licenseAll rights reserved
usagesaudio, audio
nameWavenet Unconditioned speaker-1
copyrightGoogle WaveNet
licenseAll rights reserved
usagesaudio
nameWaveNet Demo Unconditioned speaker-3
copyrightGoogle Deepmind
licenseAll rights reserved
usagesaudio
nameWaveNet Demo Piano sample_3
copyrightGoogle Deepmind
licenseAll rights reserved
usagesaudio
nameOnyx Ashanti Instagram filgood97
copyrightInstagram
licenseAll rights reserved
usagesvideo
nameWavenet-Convolutions
copyrightGoogle Deepmind
licensePublic domain
usagespicture

Comments are only available for registered users.