Your Eyes Tell: Leveraging Smooth Pursuit for Assessing Cognitive Workload
Authors
A common objective for context-aware computing systems is to predict how user interfaces impact user performance regarding their cognitive capabilities. Existing approaches such as questionnaires or pupil dilation measurements either only allow for subjective assessments or are susceptible to environmental influences and user physiology. We address these challenges by exploiting the fact that cognitive workload influences smooth pursuit eye movements. We compared three trajectories and two speeds under different levels of cognitive workload within a user study (N=20). We found higher deviations of gaze points during smooth pursuit eye movements for specific trajectory types at higher cognitive workload levels. Using an SVM classifier, we predict cognitive workload through smooth pursuit with an accuracy of 99.5% for distinguishing between low and high workload as well as an accuracy of 88.1% for estimating workload between three levels of difficulty. We discuss implications and present use cases of how cognition-aware systems benefit from inferring cognitive workload in real-time by smooth pursuit eye movements.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 67%
A Unified Model for User Identification on Multi-touch Surfaces. A Survey and Meta-analysis.
CHI '18· Eye Tracking & Gaze Interaction +1
- 67%
Modeling the Endpoint Uncertainty in Crossing-based Moving Target Selection
CHI '20· Eye Tracking & Gaze Interaction +1
- 67%
Quantification of Users' Visual Attention During Everyday Mobile Device Interactions
CHI '20· Eye Tracking & Gaze Interaction +1
- 67%
An Adaptive Model of Gaze-based Selection
CHI '21· Eye Tracking & Gaze Interaction +1
- 67%
Vergence Matching: Inferring Attention to Objects in 3D Environments for Gaze-Assisted Selection
CHI '23· Eye Tracking & Gaze Interaction +1
- 67%
Classifying Head Movements to Separate Head-Gaze and Head Gestures as Distinct Modes of Input
CHI '23· Eye Tracking & Gaze Interaction +1
- 67%
Comparing Dwell time, Pursuits and Gaze Gestures for Gaze Interaction on Handheld Mobile Devices
CHI '23· Eye Tracking & Gaze Interaction +1
- 67%
Looking but Not Focusing: Defining Gaze-Based Indices of Attention Lapses and Classifying Attentional States
CHI '25· Eye Tracking & Gaze Interaction +1
- 67%
Below the Surface: Unobtrusive Activity Recognition for Work Surfaces using RF-radar sensing
IUI '18· Human Pose & Activity Recognition +1
- 67%
Detecting low rapport during natural interactions in small groups from non-verbal behavior
IUI '18· Eye Tracking & Gaze Interaction +1
Based on Jaccard similarity of research subtopics & professions (≥60%)