CandyFly: Bringing fun to drone pilots with disabilities through adapted and adaptable interactions

Title of the Paper

CandyFly: Bringing fun to drone pilots with disabilities through adapted and adaptable interactions

Bibliographic Information

• Research Domain: Human-Computer Interaction (HCI), focusing on assistive technologies and recreational activities for individuals with disabilities
• Keywords: drones, human-drone interaction, unmanned aerial vehicles, flight control, automation, assistive technology

Research Background and Problem Statement

• Identified Issues or Challenges:
  1. Operating drones requires advanced perceptual and motor skills, such as adjusting flight posture, monitoring speed and position, which poses significant challenges for individuals with cognitive, motor, or sensory impairments.
  2. Existing drone operation systems may not be suitable for people with physical disabilities, and activities designed for individuals with disabilities often focus on rehabilitation or education, with limited emphasis on recreational activities.
• Significance:
  • Providing a drone flying experience tailored to individuals with disabilities not only fulfills their need for recreational activities but also enhances their quality of life and sense of social participation.
• Research Motivation and Related Work:
  • Current literature on assistive interaction design emphasizes technologies such as brain-computer interfaces (BCI) and gesture control for individuals with disabilities but lacks adaptable drone operation solutions for diverse disability groups.

Proposed Solution

• Proposed Solution:
  • CandyFly application: a highly adaptable drone software designed for individuals with disabilities, integrating hardware, software, and automated adjustments to meet diverse needs.
  • The application is based on the Ability-Based Design principle, focusing on user capabilities rather than limitations through research practices and iterative design.
• Innovations:
  • Offers hardware, software, and automated adjustments for drone control, supporting various physical, cognitive, and sensory abilities; establishes a personalized and adjustable software framework.
• Implementation Steps and Techniques:
  1. Hardware: Adapts to various control devices such as pressure-sensitive buttons, game controllers, and extended joysticks.
  2. Software: Allows users to personalize control mappings and adjust input device sensitivity. Provides gradual difficulty adjustments.
  3. Automated Flight: Includes preset modes and dynamic adjustments to drone flight freedom (e.g., limiting altitude or horizontal movement) to reduce operational difficulty.
  4. Research Methods: Utilizes design technical probes and a "research-design" approach, collecting feedback through user trials in real-world scenarios for iterative design.

Research Outcomes

• Specific Results:
  • Reduced learning curve for individuals with disabilities in recreational activities, significantly improving drone operation stability and safety.
  • Markedly decreased drone flight accidents; easier to operate compared to existing devices.
  • CandyFly has undergone multiple trials, receiving unanimous praise from users and their caregivers. Participants found drone flying more enjoyable and suited to their needs.
• Advantages and Comparisons:
  • Compared to traditional interaction designs, CandyFly accommodates a wider range of disabilities with more flexible interaction behaviors; compared to commercial drone controllers, it significantly reduces user burden.
• Experiment and Evaluation Results:
  • Over 3.5 years, 8 workshops were conducted with a total of 11 pilots with various types of disabilities, including cognitive, sensory, and motor impairments.
  • Some pilots demonstrated progress, such as increased flight time, enhanced complexity of movements, and reduced drone damage due to operational errors.
  • The application received positive feedback from users and caregivers, with some pilots actively requesting repeated participation.
• Limitations and Future Directions:
  • Does not cover all types of disabilities, such as adaptations for visually impaired individuals, which require further exploration.
  • Future developments could include personalized parameter recommendation systems based on questionnaires or automated methods to simplify initial configuration.
  • Further investigation into enhanced sensory feedback (e.g., auditory or tactile) for different user groups could be pursued.