Eye&Head: Synergetic Eye and Head Movement for Pointing and Selection
Eye gaze involves the coordination of eye and head movement to acquire gaze targets, but existing approaches to gaze pointing are based on eye-tracking in abstraction from head motion. We propose to leverage the synergetic movement of eye and head, and identify design principles for Eye&Head gaze interaction. We introduce three novel techniques that build on the distinction of head-supported versus eyes-only gaze, to enable dynamic coupling of gaze and pointer, hover interaction, visual exploration around pre-selections, and iterative and fast confirmation of targets. We demonstrate Eye&Head interaction on applications in virtual reality, and evaluate our techniques against baselines in pointing and confirmation studies. Our results show that Eye&Head techniques enable novel gaze behaviours that provide users with more control and flexibility in fast gaze pointing and selection.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 75%
The Effect of Offset Correction and Cursor on Mid-Air Pointing in Real and Virtual Environments
CHI '18· Full-Body Interaction & Embodied Input +1
- 75%
Predicting the Limits: Tailoring Unnoticeable Hand Redirection Offsets in Virtual Reality to Individuals’ Perceptual Boundaries
UIST '24· Full-Body Interaction & Embodied Input +2
- 67%
Walk The Line: Leveraging Lateral Shifts of the Walking Path as an Input Modality for Head-Mounted Displays
CHI '20· Full-Body Interaction & Embodied Input +1
- 60%
TapGazer: Text Entry with Finger Tapping and Gaze-directed Word Selection
CHI '22· Hand Gesture Recognition +2
- 60%
Seeing and Touching the Air: Unraveling Eye-Hand Coordination in Mid-Air Gesture Typing for Mixed Reality
CHI '25· Hand Gesture Recognition +2
- 60%
Hitchhiking Hands: Enabling “Virtually Direct” VR Manipulation by Switching Multiple Hand Avatars with Gaze
CHI '26· Identity & Avatars in XR +2
- 60%
A Faster VR Body to Speed Up Choices
CHI '26· Immersion & Presence Research +2
Based on Jaccard similarity of research subtopics & professions (≥60%)