“Can It Be Customized According to My Motor Abilities?”: Toward Designing User-Defined Head Gestures for People with Dystonia

Title of the Paper

“Can It Be Customized According to My Motor Abilities?”: Toward Designing User-Defined Head Gestures for People with Dystonia

Paper Information

• Research Area: Human-Computer Interaction (HCI), specifically the design of customized gestures for individuals with motor impairments
• Keywords: Dystonia, gesture interaction, interaction technology, user preferences, human-computer interaction

Research Background and Problem Statement

• What issues or challenges did the authors identify?

  • Current touchscreen technologies are not user-friendly for individuals with upper limb motor impairments, particularly for those with dystonia, who experience significant difficulty with eyelid gestures or fine eye movements due to facial muscle tension.
  • Existing body gesture-based interaction systems do not adequately address the specific needs of individuals with dystonia, especially in terms of facial muscle coordination and selecting appropriate gestures.

• Why is this issue important?

  • Smartphones have become essential devices, yet their accessibility remains limited to able-bodied users. Achieving universal design is crucial for promoting technological inclusivity.
  • Developing natural and easy-to-use interaction methods for special populations, such as individuals with dystonia, is an important technical goal for improving their quality of life.

• Research Motivation and Related Work

  • The motivation lies in expanding the design space of body gesture interactions to meet the unique needs of individuals with dystonia.
  • Unlike previous studies focusing on eyelid gestures and body gestures for individuals with upper limb impairments, this research focuses on designing head gestures suitable for individuals with dystonia.

Solution

• What methods or solutions did the authors propose?

  • The authors proposed a user-defined head gesture design method, collecting patient preferences through experiments and summarizing an optimized set of gestures.
  • They adopted the "guessability" method proposed by Wobbrock et al. to systematically study user-defined gestures.

• What is innovative about this solution?

  • The study focuses on the unique motor characteristics of individuals with dystonia, particularly by extending the use of facial muscles (e.g., tongue, nose) to reduce reliance on fine eye movements.
  • It is the first study to quantitatively and qualitatively analyze the preferences of this population for user-defined head gestures, forming a comparative study with other groups with motor impairments.

• Implementation Steps

  1. Recruit 16 participants with dystonia, including those at mild and severe stages, for the experiment.
  2. Use 26 commonly used smartphone interaction commands (e.g., swipe, zoom) and guide users to define their preferred head gestures through video clips and task instructions.
  3. Record each user's gestures and subjective ratings (e.g., adaptability, ease of use, social acceptability).
  4. Use quantitative methods to calculate agreement scores and combine user interviews to gain qualitative insights.
  5. Create an optimized set of recommended head gestures based on user feedback and analysis results.

Research Findings

• What specific results were achieved?

  • Collected 416 user-defined head gestures, covering multiple body parts and combinations, including eyes, head, mouth, and shoulders.
  • Developed a prioritized recommended gesture set (Set 1 and Set 2) and proposed a more natural and practical head gesture scheme for common commands.
  • Results showed that participants preferred head-based gestures, followed by mouth gestures, over fine eye movements or complex combined gestures.

• What advantages does this solution have compared to existing ones?

  • Compared to previous solutions using eyelid movements, head gestures are easier for individuals with dystonia to perform and place less strain on facial muscles.
  • The gesture designs exhibited high consistency (e.g., contextually relevant gestures for swipe commands) and better support for real-life interaction scenarios.

• What were the experimental or evaluation results?

  • Head movement gestures accounted for 34.8% of all gestures, significantly higher than eye movements (17.6%) and mouth movements (18%).
  • Commands such as "swipe up" and "swipe down" achieved high agreement scores (Ac = 0.492), indicating high predictability for these interaction gestures.
  • Social acceptance scores were positively correlated with agreement levels (r = 0.493, p < 0.05), indicating that social acceptability is an important factor influencing user preferences for gestures.

• Limitations and Future Directions

  • Limitations:
    • The sample size was small, with only 16 participants, which may limit the generalizability of the results.
    • Gesture proposals from participants with mild to moderate dystonia were highly recognizable, but the feasibility for individuals with severe dystonia requires further validation.
    • Limitations in gesture recognition technologies (e.g., cameras) for detecting subtle movements may impact practical application.
  • Future Directions:
    • Expand the sample size and explore adaptability for individuals with other types of motor impairments.
    • Investigate how to improve the accuracy of gesture recognition hardware and algorithms, including handling non-standard movements caused by facial muscle tension.
    • Explore the potential of using less common body parts, such as the tongue, in gesture interactions to enhance diversity and adaptability.

Conclusion

This study is the first to systematically design and validate a user-defined head gesture interaction scheme for individuals with dystonia. It proposed an optimized set of gestures and demonstrated the potential of head and mouth movements in smartphone interactions, significantly expanding the design space for inclusive interaction technologies.