A master thesis from Aalborg University
Danish Sign Language Recognition in Virtual Reality Using Written Language Ensemble Learning
Author(s)
Term
4. term
Education
Publication year
2023
Submitted on
2023-05-25
Pages
23 pages
Abstract
This work presents a multimodal ensemble Sign Language Recognition (SLR) model using an n-gram linear classifier for Natural Language Processing, a vector encoding based on Euclidean distances for gesture recognition, and a fusion approach for confluencing the two. Furthermore, this work proposes a Virtual Reality (VR) User Interface (UI) based on prevailing usability heuristics. The SLR model was shown to have a mean classification accuracy of 41.5%, which is meaningfully below the state of the art, while the VR UI was found to not allow for sufficient levels of Adaptability. Still, there exists many ways in which the components of the SLR model could be improved, and it is the hope that derivative works can make use of the findings presented here for this.
Documents
Colophon: This page is part of the AAU Student Projects portal, which is run by Aalborg University. Here, you can find and download publicly available bachelor's theses and master's projects from across the university dating from 2008 onwards. Student projects from before 2008 are available in printed form at Aalborg University Library.
If you have any questions about AAU Student Projects or the research registration, dissemination and analysis at Aalborg University, please feel free to contact the VBN team. You can also find more information in the AAU Student Projects FAQs.