How They Type: Eye and Finger Movement Strategies in Typing of Individuals with Cerebral Palsy

Paper Title

How They Type: Eye and Finger Movement Strategies in Typing of Individuals with Cerebral Palsy

Publication Info

• Topic area: Typing behaviors and compensatory strategies in individuals with cerebral palsy (CP).
• Keywords: Typing efficiency, cerebral palsy, eye tracking, finger usage, motor impairments, assistive technologies, human-computer interaction, input behavior, visual strategies, adaptive systems.

Background and Problem

• Problem / challenge: Existing research on typing behaviors in individuals with motor impairments, particularly cerebral palsy, is limited to macro-level metrics like speed and accuracy, without delving into the adaptive strategies used to manage motor and visual constraints.
• Significance: Understanding these strategies is critical for designing personalized assistive technologies that enhance communication and digital accessibility for individuals with CP.
• Motivation and related work: Prior studies have explored assistive technologies like scanning keyboards and eye-tracking systems but lack detailed insights into how CP users regulate attention, movement rhythms, and finger strategies. This study addresses this gap by analyzing typing behaviors at a granular level.

Solution

• Proposed approach: A comprehensive analysis of typing behaviors in individuals with CP using keystroke logging, eye tracking, and motion capture to uncover adaptive strategies and inform assistive technology design.
• Novelty:
  1. Identification of distinct visual and motor strategies in CP typists, including gaze patterns and finger usage.
  2. Subtype-specific analysis of typing rhythms (spastic vs. athetoid CP).
  3. Introduction of new metrics (e.g., inter-key interval variability, fixation dynamics, finger clustering) for evaluating typing efficiency.
  4. Public release of a dataset on typing behaviors in CP typists to support further research.
• Procedure and key techniques:
  1. Recruited 31 CP typists and 31 non-disabled typists for comparison.
  2. Conducted typing tasks with pinyin and random string inputs, capturing data on keystrokes, finger movements, and gaze shifts.
  3. Analyzed typing performance (speed, rhythm, accuracy), visual strategies (fixation patterns, gaze shifts), and motor strategies (finger usage, clustering).
  4. Examined correlations between typing efficiency and factors like disability level and visual attention.

Results

• Concrete findings:
  • CP typists typed slower (WPM: 8.77 vs. 39.66 in pinyin) and with higher inter-key interval variability (708 ms vs. 140 ms in pinyin) but achieved comparable keyboard efficiency (0.75 vs. 0.76).
  • CP typists exhibited shorter fixation durations (488 ms vs. 1089 ms) and more frequent gaze shifts (4.29 vs. 2.02 per sentence).
  • Five distinct finger usage strategies were identified, with CP typists often relying on fewer fingers (4.67 vs. 6.88 on average).
  • Spastic CP typists followed a "slow but steady" rhythm, while athetoid CP typists exhibited a "fast but unstable" rhythm.
• Advantage over baselines: The study provides deeper insights into the compensatory mechanisms of CP typists, going beyond traditional metrics like speed and accuracy to include visual and motor coordination patterns.
• Experiments / evaluation:
  • Participants: 31 CP typists (20 spastic, 11 athetoid) and 31 non-disabled typists.
  • Metrics: WPM, inter-key interval (IKI), error rate, fixation patterns, finger usage.
  • Tools: Motion capture, keyboard logging, Tobii Pro Glasses for eye tracking.
• Limitations and future work:
  • Limited task diversity and lack of stratified analysis by age or severity.
  • Exclusion of modern keyboard features like predictive text.
  • Focused only on physical keyboards, not touch or multimodal inputs.
  • Future work should explore virtual/augmented reality keyboards, multimodal inputs, and longitudinal studies.

Summary

This study investigates the typing behaviors of individuals with cerebral palsy, revealing slower speeds, higher rhythm variability, and distinct visual and motor strategies compared to non-disabled typists. CP typists prioritize accuracy over speed, using compensatory mechanisms like frequent gaze shifts and limited finger usage. Subtype-specific differences highlight the need for tailored assistive technologies. The findings emphasize the importance of designing adaptive systems that support self-regulation and optimize typing efficiency for CP users. Future research should expand to virtual keyboards, multimodal inputs, and longitudinal analyses to further enhance accessibility solutions.