Eye Movement Classification Using Deep Learning

Djanian, Shagen

4. term

Vision, Graphics and Interactive Systems, Master

2019

2019-06-06

82 pages

This projects outlines how to choose a good eye movement dataset and evaluate a deep learning approach to eye movement classification. A thorough investigation of the annotation of the GazeCom dataset was performed. By looking at different feature distributions and event durations of eye movements it was possible to show that the annotations did not comply with the physiological properties of said movements. A similar investigation was performed on the Lund 2013 dataset and this showed that the features were in agreement with physiological properties. A 1D Convolutional Neural Network Bidirectional Long Short-Term Memory (1D-CNN-BLSTM) neural network was trained on the Lund 2013 dataset to classify fixations, saccades, smooth pursuit and post-saccadic oscillation. Different model parameters and eye movement features were tested. The best performing model was a multi resolution 1D-CNN-BLSTM but it as not outperforming the other neural networks by much. The biggest challenge was differentiating between fixations and smooth pursuit and this was not solved.

Eye tracking ; eye movements ; machine learning ; deep learning ; neural network ; datasets ; smooth pursuit ; post-saccadic oscillations ; saccade ; fixation ; event level evaluation

Download
View record in AAU Student Projects