M3 Gesture Menu: Design and Experimental Analyses of Marking Menus for Touchscreen Mobile Interaction
Authors
Despite their learning advantages in theory, marking menus have faced adoption challenges in practice, even on today's touchscreen-based mobile devices. We address these challenges by designing, implementing, and evaluating multiple versions of M3 Gesture Menu (M3), a reimagination of marking menus targeted at mobile interfaces. M3 is defined on a grid rather than in a radial space, relies on gestural shapes rather than directional marks, and has constant and stationary space use. Our first controlled experiment on expert performance showed M3 was faster and less error-prone by a factor of two than traditional marking menus. A second experiment on learning demonstrated for the first time that users could successfully transition to recall-based execution of a dozen commands after three ten-minute practice sessions with both M3 and Multi-Stroke Marking Menu. Together, M3, with its demonstrated resolution, learning, and space use benefits, contributes to the design and understanding of menu selection in the mobile-first era of end-user computing.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 100%
PinchList: Leveraging Pinch Gestures for Hierarchical List Navigation on Smartphones
CHI '19· Hand Gesture Recognition
- 75%
GestAKey: Touch Interaction on Individual Keycaps
CHI '18· Hand Gesture Recognition +1
- 75%
VirtualGrasp: Leveraging Experience of Interacting with Physical Objects to Facilitate Digital Object Retrieval
CHI '18· Hand Gesture Recognition +1
- 75%
Projective Windows: Bringing Windows in Space to the Fingertip
CHI '18· Hand Gesture Recognition +1
- 75%
Designing, Engineering, and Evaluating Gesture User Interfaces
CHI '18· Hand Gesture Recognition +1
- 75%
HotStrokes: Word-Gesture Shortcuts on a Trackpad
CHI '19· Hand Gesture Recognition +1
- 75%
HandSee: Enabling Full Hand Interaction on Smartphone with Front Camera-based Stereo Vision
CHI '19· Hand Gesture Recognition +1
- 75%
BackTrack: 2D Back-of-device Interaction Through Front Touchscreen
CHI '21· Hand Gesture Recognition +1
- 75%
AtaTouch: Robust Finger Pinch Detection for a VR Controller Using RF Return Loss
CHI '21· Hand Gesture Recognition +1
- 75%
Switching Between Standard Pointing Methods with Current and Emerging Computer Form Factors
CHI '22· Hand Gesture Recognition +1
Based on Jaccard similarity of research subtopics & professions (≥60%)