Concept: This project aims to explore the methods of linking architecture and music on the levels of structure and cognition.We realize that the relationship between music and architecture is not just a matter of musical/ architectural structure or musical/ architectural material. Rather, utilizing the researches of cognitive science, an exploration of how humans experience and recognize music and architecture. We plan to advance our research by utilizing our program that we have developed, which maps the principles of architectural concept onto the principles of musical concept. One of this project’s objective is to verify our hypothesis – the modality of architecture and music that contradicts, however, the perceptual cognition and the perception of aesthetical order maintains a bridge in the deeper structural levels. By simultaneously generating the architectural and spatial sequences, and musical works using the computer program, it enables the viewers to see, and the listeners to hear, concluding with verifying the cognitive hypothesis.
Realization: By utilizing the self-developed computer program for simultaneously autogenerating architectural spaces and musical works, we are developing a system that expresses the perceptual perception, as well as decoding the link between our hypothesis, that both architecture and music have the same fundamental structure of aesthetical order. Throughout this process of development, we have reiterated countless experiments using our eyes and ears. The work is finally at the stage of it being able to present the first version. Our computer program auto-generates both the architectural space and music by maturating parts by parts, perceiving spatiality and musicality, as well as offering interactive experiences by mapping multidimensionality.
Software: The software, as of now, is being developed as a web application. The user constructs the architectural elements (e.g. pillar, floor, wall, roof or abstract forms etc..) by creating a patch. The patch, which utilizes the files for 3D-CG animation software BLENDER and PNG files, create the architectural space. After selecting the patch and delivering the BUILD commands, music – MIDI file, mp3 sound files, and the musical scores in PDF format – is automatically generated. These are all rendered online, and only the files will be delivered to the user. You can play the MIDI file directly or use its data as control-signals to synthesize sounds.