Stroke-Gesture Input for People with Motor Impairments: Empirical Results & Research Roadmap
Authors
We examine the articulation characteristics of stroke-gestures produced by people with upper body motor impairments on touchscreens as well as the accuracy rates of popular classification techniques, such as the $-family, to recognize those gestures. Our results on a dataset of 9,681 gestures collected from 70 participants reveal that stroke-gestures produced by people with motor impairments are recognized less accurately than the same gesture types produced by people without impairments, yet still accurately enough (93.0%) for practical purposes; are similar in terms of geometrical criteria to the gestures produced by people without impairments; but take considerably more time to produce (3.4s vs. 1.7s) and exhibit lower consistency (-49.7%). We outline a research roadmap for accessible gesture input on touchscreens for users with upper body motor impairments, and we make our large gesture dataset publicly available in the community.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 100%
PersonalTouch: Improving Touchscreen Usability by Personalizing Accessibility Settings based on Individual User's Touchscreen Interaction
CHI '19· Motor Impairment Assistive Input Technologies
- 100%
A Performance Evaluation of Nomon: A Flexible Interface for Noisy Single-Switch Users
CHI '22· Motor Impairment Assistive Input Technologies
- 75%
Understanding the Accessibility of Smartphone Photography for People with Motor Impairments
CHI '18· Motor Impairment Assistive Input Technologies +1
- 75%
Nonvisual Interaction Techniques at the Keyboard Surface
CHI '18· Visual Impairment Technologies (Screen Readers, Tactile Graphics, Braille) +1
- 75%
CandyFly: Bringing fun to drone pilots with disabilities through adapted and adaptable interactions
CHI '22· Motor Impairment Assistive Input Technologies +1
- 75%
Crownboard: A One-Finger Crown-Based Smartwatch Keyboard for Users with Limited Dexterity
CHI '23· Foot & Wrist Interaction +1
- 75%
Designing Upper-Body Gesture Interaction with and for People with Spinal Muscular Atrophy in VR
CHI '24· Full-Body Interaction & Embodied Input +1
- 75%
“Can It Be Customized According to My Motor Abilities?”: Toward Designing User-Defined Head Gestures for People with Dystonia
CHI '24· Human Pose & Activity Recognition +1
- 75%
Imagine, Interact: Eliciting Accessible Interactions from Users with Motor Impairments via Imagined Input Devices
CHI '26· Motor Impairment Assistive Input Technologies +1
- 75%
Write-it-Yourself with the Aid of Smartwatches: A Wizard-of-Oz Experiment with Blind People
IUI '18· Deaf & Hard-of-Hearing Support (Captions, Sign Language, Vibration) +1
Based on Jaccard similarity of research subtopics & professions (≥60%)