Seeing our Blind Spots: Smart Glasses-based Simulation to Increase Design Students Awareness of Visual Impairment

Title of the Paper

Seeing our Blind Spots: Smart Glasses-based Simulation to Increase Design Students’ Awareness of Visual Impairment

Paper Information

• Topic Area: Wearable devices and assistive technologies in human-computer interaction
• Keywords: visual impairment, smart glasses, eye tracking, age-related vision decline, design education, augmented reality, central vision loss, peripheral vision loss

Research Background and Problem Statement

• What problems or challenges did the authors identify?

  • With the aging population, the number of individuals with visual impairments continues to grow, yet many public facilities and product designs still assume normal vision, neglecting the needs of visually impaired users.
  • Existing visual impairment simulation tools (e.g., simulation glasses or 2D image simulations) lack adaptation to eye tracking and fail to accurately recreate real visual experiences. Simulation methods based on VR or AR face limitations such as restricted field of view, vergence-accommodation conflict (VAC), and device weight.

• Why is this problem important?

  • Designing more inclusive technologies and products for visually impaired users requires designers to have a deeper understanding and empathy for the visual impairment experience.
  • Enhancing awareness of visual impairment can improve designers' empathy, thereby promoting design practices that better meet accessibility requirements.

• Research Motivation and Related Work:

  • Many related studies attempt to help users experience visual impairments through simulation tools (e.g., static glasses, 2D image simulations, head-mounted displays), but these tools have shortcomings in simulation realism, usability, and adaptation to real-time scenarios.
  • Specific conditions such as open-angle glaucoma and age-related macular degeneration are typical manifestations of vision loss, leading to peripheral vision loss and central vision loss, respectively. Simulating these two types of conditions can help design students better understand the needs of visually impaired users.

Proposed Solution

• What methods or solutions did the authors propose?

  • Developed a novel lightweight smart glasses system that combines optical see-through display technology with real-time eye tracking to dynamically generate various visual impairment effects (e.g., central vision loss and peripheral vision loss).
  • Designed a variable visual impairment simulation mode that adjusts the transparency and shape of the display to simulate different severity levels and types of visual impairments.
  • The simulation experience covers a natural wide field of view (160° horizontal and 140° vertical) and avoids common issues in VR/AR devices such as vergence-accommodation conflict.

• What are the innovative aspects of this solution?

  • Real-time eye tracking enables the simulation effects to dynamically correlate with the user’s gaze, enhancing realism and immersion.
  • Optical transparency design avoids the vergence-accommodation conflict, allowing users to experience visual impairments in natural environments.
  • Lightweight system design (only 89.6g) enables users to wear the glasses during daily activities and obtain real-time simulation experiences.

• What are the implementation steps and key technologies used?

  • Hardware: Developed semi-transparent lenses based on liquid crystal displays (LCD) and integrated Pupil CORE eye tracking devices.
  • Software: Processed eye tracking data using Python scripts to generate real-time visual impairment effects and render them on the LCD screen.
  • User Testing: Evaluated the effectiveness of the glasses in simulating visual impairments in a laboratory setting, including vision tests, field of view tests, and user feedback during everyday object search tasks.

Research Findings

• What specific results were achieved?

  • Verified that the central vision impairment mode significantly reduces users’ visual clarity (average visual acuity score in vision tests decreased from 7.7 to 5.5).
  • Verified that the peripheral vision impairment mode significantly narrows users’ field of view, particularly at horizontal and vertical visual boundaries.
  • User feedback indicated that the smart glasses significantly enhanced participants’ awareness and empathy for visual impairments without causing severe visual fatigue or headaches.

• How does it compare to existing solutions?

  • Compared to static glasses and 2D image simulations, the new method dynamically adapts to eye movements, offering higher simulation realism.
  • Compared to VR/AR head-mounted devices, its lightweight design and wide field of view provide a more natural experience and avoid motion sickness risks.
  • Broad applicability in daily scenarios, supporting walking and task operations.

• What were the experimental or evaluation results?

  • Experiments included vision and field of view tests, object search tasks, and questionnaire surveys. Results showed the glasses’ visual impairment simulation effects were significant, and participants’ perception and empathy for visually impaired users were notably enhanced.
  • Questionnaire data indicated that over 80% of participants gained increased awareness and understanding of visual impairment experiences and design needs after using the glasses.

• Limitations and Future Directions

  • The system’s weight (still heavier than regular glasses) and refresh rate (approximately 100ms delay) need further optimization to improve wearing comfort.
  • The current model cannot fully cover extreme visual field boundaries for some users (e.g., far-left and far-right edges). Future plans include improving the display module and lens shape.
  • Next steps will involve verifying the accuracy of the simulation’s mapping to real visual impairment experiences and testing performance in more complex tasks and scenarios.