Music Training Game for CI Users using Real Time Simulated Instruments
Authors
Knudsen, Erik Frej ; Nuijens, Emo Helmer
Term
4. Term
Education
Publication year
2022
Submitted on
2022-05-25
Pages
84
Abstract
Denne afhandling beskriver, hvordan vi designede og udviklede Uncharted Chants, et spil der hjælper personer med cochlear implantat (CI) med at træne musikopfattelse. Et cochlear implantat er et høreapparat, der stimulerer hørenerven og kan gøre det udfordrende at skelne musikalske nuancer. Målet er at gøre træningen mere motiverende ved at bruge principper fra spilbaseret læring, som for eksempel klare mål, feedback og meningsfulde udfordringer. Spillet skaber instrumentlignende lyde ved hjælp af fysiske modeller i realtid – matematisk modellerede simulationer af, hvordan instrumenter laver lyd – så lyden reagerer øjeblikkeligt på spillerens handlinger. Vi evaluerede spillet med tests af præstation, brugervenlighed og brugeroplevelse hos både normalhørende og CI-brugere. Resultaterne viser, at spilidéen kan øge engagementet i musiktræningsøvelser. Derudover blev de syntetiserede lyde opfattet som realistiske, og spillerne kunne opfatte små forskelle i klang (timbre) afhængigt af deres interaktioner.
This thesis describes the design and development of Uncharted Chants, a game that helps people with cochlear implants (CIs) practice music perception. A cochlear implant is a hearing device that stimulates the auditory nerve, which can make musical nuances harder to distinguish. The goal is to make training more motivating by applying game-based learning principles, such as clear goals, feedback, and meaningful challenges. The game generates instrument-like sounds using real-time physical modeling—mathematical simulations of how instruments produce sound—so audio responds instantly to player actions. We evaluated the game with performance, usability, and user experience tests involving both normal-hearing listeners and CI users. Results indicate that the game concept can increase engagement with music training exercises. In addition, the synthesized sounds were perceived as realistic, and players could detect small differences in timbre (tone color) based on different interactions.
[This summary has been rewritten with the help of AI based on the project's original abstract]
Documents