The Effects of Interaction Modalities on User Engagement in Simulations: An Exploratory Analysis Method applied in Sim Racing and a VR Training app
Translated title
The Effects of Interaction Modalities on User Engagement in Simulations
Authors
Jensen, Jacob Almdal ; Mitchell, Lucas Friborg
Term
4. term
Education
Publication year
2026
Submitted on
2026-05-26
Pages
38
Abstract
This thesis examines how user engagement relates to multi-modal feedback and task performance in simulation environments. Using an exploratory design, it investigates how different control modalities (ways of interacting), feedback types, and a sense of agency (feeling in control) influence engagement and performance across two simulators. In a racing simulator, participants were asked to drive as fast and as cleanly as possible under three conditions: a control phase with no feedback; a feedback phase with either force feedback (physical forces) or environmental feedback (cues from the virtual environment); and an all phase with both feedback modalities active. A second test used a VR neonatal resuscitation simulator to examine agency and control modalities across three setups: no haptics, haptics, and hand tracking. Self-reported engagement was measured with the UES-SF questionnaire, and both subjective ratings and objective performance metrics were collected in both simulators. The findings highlight both the potential and the challenges of assessing engagement across different simulator domains and support the use of multidimensional approaches for future simulator engagement research.
Specialet undersøger, hvordan brugerengagement hænger sammen med multimodal feedback og opgavepræstation i simuleringsmiljøer. Med en eksplorativ tilgang belyses, hvordan forskellige kontrolmodaliteter (måder at styre systemet på), typer af feedback og oplevet agency (følelsen af kontrol) påvirker engagement og præstation på tværs af to simulatorer. I en racingsimulator skulle deltagerne køre så hurtigt og så fejlfrit som muligt under tre betingelser: en kontrolfase uden feedback; en feedbackfase med enten kraftfeedback (fysiske kræfter) eller miljøfeedback (signaler fra det virtuelle miljø); samt en fase med begge feedbackmodaliteter aktiveret. Den anden test brugte en VR-simulator til neonatal genoplivning for at undersøge agency og kontrolmodaliteter i tre opsætninger: uden haptik, med haptik og med håndsporing. Brugernes selvrapporterede engagement blev målt med UES-SF-spørgeskemaet, og der blev indsamlet både subjektive vurderinger og objektive præstationsmålinger i begge simulatorer. Resultaterne fremhæver både muligheder og udfordringer ved at vurdere engagement på tværs af simulatorområder og peger på behovet for multidimensionelle tilgange i fremtidig forskning i simulatorengagement.
[This apstract has been rewritten with the help of AI based on the project's original abstract]
Keywords
Engagement ; HCI ; Simulation