Enhancing a Virtual Reality Game with Sonic Interaction and Adaptive Music

Forbedring af et Virtual Reality spil med sonisk interaktion and adaptiv musik

Maunsbach, Martin Lennart Wendelboe

4. Term

Sound and Music Computing

2019

2019-06-28

91

Denne afhandling undersøger, om sonisk interaktion og adaptiv musik kan forbedre et virtual reality (VR) beat‑slicing-spil—et rytmespil, hvor spilleren skærer i musikalske elementer. Med sonisk interaktion menes styring og skabelse af lyd gennem kropslige bevægelser og gestik. Vi implementerer dette som virtuelle musikinstrumenter i VR, inspireret af fysiske instrumenters design og lydsyntese-teknikker. Vi undersøger også adaptiv musik—musik, der ændrer sig i realtid som reaktion på spillerens handlinger eller begivenheder i spillet—og udvikler passende anvendelser til spillet. For at afprøve idéerne bygger vi en grundversion af et eksisterende spilkoncept i spilmotoren Unity og integrerer de soniske interaktioner og den adaptive musik. Funktionerne testes derefter med brugere, resultaterne diskuteres, og der foreslås retninger for fremtidige forbedringer.

This thesis examines whether sonic interaction and adaptive music can enhance a virtual reality (VR) beat‑slicing game—a rhythm game in which players slice musical elements. By sonic interaction, we mean controlling and producing sound through body movement and gestures. We implement these interactions as VR musical instruments, informed by the design of physical instruments and by sound synthesis techniques. We also explore adaptive music—music that changes in real time in response to player actions or game events—and create appropriate uses for the game. To test these ideas, we build a base version of an existing game concept in the Unity game engine and integrate the sonic interactions and adaptive music. We then conduct user testing of these features, discuss the findings, and suggest directions for future improvement.

[This abstract was generated with the help of AI]

Download
View record in AAU Student Projects