Augmented Reality Glasses as an Orientation and Mobility Aid for People with Low Vision: a Feasibility Study of Experiences and Requirements

Title of the Paper

Augmented Reality Glasses as Orientation and Mobility Aids for Individuals with Low Vision: Feasibility Study and Needs Analysis

Paper Information

• Subject Area: Application of Augmented Reality Technology in Assistive Devices for Low Vision
• Keywords: Low Vision, Mobility Assistance, Augmented Reality, Visual Enhancement, User Needs Analysis, Feasibility Study, Interaction Design, Orientation and Navigation

Research Background and Problem Statement

• Issues or Challenges:

  1. A large global population with low vision faces orientation and mobility challenges, but existing assistive tools have limited effectiveness.
  2. Current research on augmented reality-based assistive tools primarily focuses on technological development, neglecting the practical needs and usability for diverse user groups.
  3. Many studies fail to incorporate end-user feedback during the early design stages, leading to technical assumptions that may not fully reflect the diverse navigation methods of individuals with low vision.

• Significance: Enhancing the orientation and mobility capabilities of individuals with low vision not only improves their safety but also significantly enhances psychological well-being and independence in daily life.

• Research Motivation and Related Work:

  1. In recent years, various sensor-based assistive tools (e.g., ultrasonic sensors, depth sensors, cameras) have been proposed for environmental information acquisition. However, for users with residual vision, these visual substitution methods may not be intuitive.
  2. Head-mounted display (HMD) devices based on augmented reality offer a hands-free and intuitive way to present information, leveraging residual vision.
  3. Previous studies have demonstrated the effectiveness of certain algorithms (e.g., scene simplification, distance information display) in improving visual function under experimental conditions, but their impact on mobility efficiency in real-world scenarios has not been systematically validated.

Proposed Solution

• Proposed Methods or Solutions:

  1. Develop and test eight visual enhancement prototypes based on augmented reality devices (HoloLens v1) to improve the orientation and mobility experience of individuals with low vision.
  2. Conduct user experience research through interviews with 18 participants, covering a range of visual conditions from mild to severe low vision.

• Innovative Contributions:

  1. Integrating technological development with user experience research to provide theoretical and practical guidance for designing assistive tools for low vision, addressing gaps in existing literature regarding user needs.
  2. Introducing a wide range of prototype functionalities (e.g., depth perception, dynamic magnification, object recognition, and navigation guidance) and evaluating their strengths and weaknesses based on real user feedback.
  3. Emphasizing the high customizability of the solution to accommodate the diverse needs of different low vision groups.

• Implementation Steps:

  1. Develop eight prototypes, including:
     • Wall boundary visualization
     • Color-based depth perception overlay
     • Contour enhancement
     • High-contrast imaging
     • Real-time scene magnification
     • Object recognition and navigation path guidance
  2. Participants wear the HoloLens to view augmented perspectives and perform specific tasks (e.g., obstacle detection, path planning) using each prototype.
  3. Conduct semi-structured interviews to gather feedback, including user preferences, dislikes, and suggestions for improvement.

Research Outcomes

• Specific Findings:

  1. Augmented reality glasses perform well in enhancing environmental awareness (e.g., depth perception, obstacle recognition) for individuals with low vision.
  2. Visual enhancements are most effective for users with relatively better residual vision (visual acuity greater than 2/60).
  3. Participants generally appreciated the navigation guidance functionality and visual cues for obstacles.

• Advantages Over Existing Solutions:

  1. Flexible and highly customizable design is more intuitive and functional compared to traditional optical aids (e.g., monocular telescopes).
  2. Combines visual enhancement with traditional navigation functions, offering greater practicality.

• Experimental or Evaluation Results:

  1. Most participants found real-time enhanced images (e.g., high-contrast images) to improve their perception of visual details.
  2. However, some prototypes (e.g., color-based depth perception overlay) were less favored due to excessive visual coverage, which some users found uncomfortable.
  3. Technical limitations include a narrow field of view, latency, and imprecise image alignment.

• Limitations and Future Directions:

  1. Limitations:
     • Current hardware performance (e.g., slow depth sensors, limited field of view) restricts practical applications.
     • Sample bias toward individuals with relatively high independence, lacking comprehensive representation of specific conditions (e.g., macular degeneration).
     • Primarily evaluated in indoor settings, with insufficient coverage of complex outdoor environments.
  2. Future Directions:
     • Improve device performance (e.g., faster depth sensing, wider field of view).
     • Enhance image stability and ensure adjustable color settings.
     • Add more user-oriented features alongside hardware improvements (e.g., automatic face or text recognition).
     • Optimize visual enhancement strategies for different types of visual impairments to develop more personalized solutions.