AAU Student Projects - visit Aalborg University's student projects portal
A master's thesis from Aalborg University
Book cover


Design and Evaluation of a Multi-touch Mobile Instrument, Implementing Polygonal Waveform Synthesis

Author

Term

4. Term

Publication year

2018

Submitted on

Abstract

Mobile devices offer significant potential for expressive musical interaction, yet many apps mimic existing instruments and follow the WIMP paradigm rather than exploiting touchscreens. This thesis investigates how multi-touch gestures and a symbolic, graphics-driven user interface can support expressive, multi-parameter control in mobile digital musical instruments. It synthesizes relevant research in graphical sound, DMI design, and multi-touch interaction to outline a design space, and then develops a tablet application implementing polygonal waveform synthesis combined with modern anti-aliasing. The system explores parameter mappings, gesture sets, and visual feedback grounded in the algorithm’s geometric representation. The prototype is evaluated with attention to usability, gesture preferences, and GUI/visual feedback, and the evaluation highlights important considerations for gesture design for multi-parameter control while pointing to future development. The work contributes a practical instrument and a set of design considerations for mobile, multi-touch DMIs, initiating an iterative design process.

Mobile enheder rummer stort potentiale for udtryksfuld musikalsk interaktion, men mange apps efterligner kendte instrumenter og følger WIMP-paradigmet i stedet for at udnytte berøringsskærmens muligheder. Denne afhandling undersøger, hvordan multi-touch-gestik og en symbolsk, grafikdrevet brugerflade kan understøtte udtryksfuld, flerparametrisk kontrol i mobile digitale musikinstrumenter. Arbejdet samler central forskning i grafisk lyd, DMI-design og multi-touch-interaktion for at skitsere et designrum og udvikler derefter en tabletapplikation, der implementerer polygonal bølgeformsyntese kombineret med moderne anti-aliasing. Systemet udforsker parameter-mapping, gestusdesign og visuel feedback forankret i algoritmens geometriske repræsentation. Prototypen evalueres med fokus på brugbarhed, gestuspræferencer og GUI/visuel feedback, og evalueringen fremhæver vigtige hensyn for gestusdesign til flerparametrisk kontrol samt peger på fremtidige udviklingstrin. Afhandlingen bidrager med et konkret instrument og et sæt designovervejelser til mobile, multi-touch-baserede DMIs og igangsætter en iterativ designproces.

[This apstract has been generated with the help of AI directly from the project full text]