Musical XR & Spatial Audio: Developing Virtual Environments for Research in Music Composition and Performance

This thesis explores the convergence of spatial audio and Extended Reality (XR) technologies to advance the field of music composition and performance. It addresses fundamental gaps in the understanding and application of these technologies in creating immersive musical experiences. The research focuses on the development and evaluation of several innovative virtual environments that facilitate new approaches to musical interaction and expression. Key contributions of this work include the development of single-user and multi-user virtual environments that integrate spatial audio techniques, primarily focusing on Ambisonics and binaural audio, along with various gesture-based techniques. These environments equip musicians and composers with novel tools for sound exploration. The thesis also offers an in-depth analysis of user interaction within these environments, employing both quantitative and qualitative research methods to evaluate the impact of these technologies on musical creativity and performance. Furthermore, the creation and dissemination of open-source software and Virtual Reality systems and interfaces, along with their open-source code, encourage broader experimentation and development within the musical XR field. Through a blend of experimental studies, system developments, and review analysis, this work not only proposes new design guidelines and enhances the use of spatial audio in the various fields proposed, but also provides practical systems, interfaces, and tools for musicians, composers, sound designers, sound engineers, performers, and researchers. These efforts have been documented in eleven peer-reviewed publications in top-tier journals and presented at high-level international conferences, highlighting the practical relevance and academic contribution of this thesis.

Grantor dc:publisher

Università degli studi di Trento

Year dc:date

2024

Author dc:creator

• Tomasetti, Matteo

Contributors dc:contributor

• Turchet, Luca

• Spatial Audio, Musical XR, Musical Metaverse, Human-Computer Interaction, New Interfaces for Musical Expression

Statement dc:rights

• info:eu-repo/semantics/openAccess
• license:Tutti i diritti riservati (All rights reserved)
• license uri:iris.PRI01

Language dc:language

eng

Identifier

http://dx.doi.org/10.15168/11572_439195
10.15168/11572_439195

OAI identifier oai:identifier

oai:iris.unitn.it:11572/439195