A Design Space for Vision Augmentations and Augmented Human Perception using Digital Eyewear

Title of the Paper

A Design Space for Vision Augmentations and Augmented Human Perception using Digital Eyewear

Paper Information

• Field of Study: Applications of AI and augmented reality technology in extending and assisting human visual perception
• Keywords: design space, vision augmentation, augmented reality, mixed reality, visual impairment, human augmentation, sensory augmentation, accessibility technology, human-computer interaction, vision compensation

Research Background and Problems

• Problems and Challenges:

  • Although head-mounted displays and digital eyewear have long been used in augmented reality (AR) research, there is a lack of systematic analysis on leveraging such devices to enhance the human visual system, such as compensating for visual impairments or extending visual capabilities.
  • There is currently a lack of comprehensive classification and exploration of innovative design possibilities in this field, which limits the discovery of new technologies and directions.

• Significance:

  • Vision augmentation can not only compensate for visual impairments but also extend the visual capabilities of individuals with normal vision, such as improving spatial perception, reducing social anxiety, and enhancing attention management.
  • For the rapidly developing fields of augmented reality and digital eyewear technology, a structured research framework will guide future research and the design of solutions.

• Research Motivation and Related Work:

  • Traditional AR research primarily focuses on integrating 3D information into the user's environment, whereas vision augmentation focuses on altering the visual representation of the physical world based on user needs.
  • Research in this area is highly interdisciplinary (e.g., human-computer interaction, ophthalmology, computational optics). While some studies aim to compensate for color vision deficiencies or low vision, there is no comprehensive design space framework.
  • The design space approach has been used in other HCI fields to explore all possible solutions but has not yet been applied to the field of vision augmentation.

Solution

• Proposed Method:

  • The authors establish a design space framework for vision augmentation through morphological analysis and use it to classify existing solutions and generate new design options.

• Methodological Innovation:

  • Using the visual domain as the foundational category, the authors propose that vision augmentation operations can be defined as modulating information within the visual domain or mapping from a source domain to a target domain.
  • This design space not only reveals the limitations of existing methods but also proposes potential new directions and provides a unified terminology framework.

• Implementation Steps:

  1. Define Vision Augmentation:
     • Define vision augmentation as a field that extends human visual perception through technological sensors and optical devices.
  2. Identify Design Dimensions:
     • Extract six major visual domains applicable to vision augmentation: stimulus field, focus, light perception, time, binocular vision, and patterns.
  3. Create the Design Space through Morphological Analysis:
     • Form the design space by mapping from the visual source domain to the target domain, covering all possible augmentation combinations.
  4. Utilize the Design Space:
     • Use it to classify existing solutions (technical view, application view) and generate new design options.
  5. Validate New Designs:
     • Implement two new design prototypes (compensating for color vision deficiencies and expanding the visual field) and provide preliminary implementation results.

Research Outcomes

• Specific Results:

  • Established the first design space for the field of vision augmentation, covering all combinations of visual source and target domains through modulation and transformation operations.
  • Proposed multiple views of the design space based on technology, existing work, or applications, classifying current methods and identifying unexplored augmentation combinations.
  • Generated and prototyped five novel design options that had not been proposed before, including color vision transformation to focus and stimulus domain to binocular vision augmentation.

• Advantages:

  • The design space provides a systematic approach to vision augmentation, enabling researchers to organize existing knowledge, identify unexplored areas, and design new solutions.
  • Offers a unified terminology and framework to facilitate interdisciplinary research collaboration.
  • Demonstrates the adaptability and guidance of the design space for rapidly evolving AR hardware (e.g., VSTHMD, OSTHMD).

• Experimental or Evaluation Results:

  • Prototype implementations based on the Varjo XR-3 video see-through head-mounted display demonstrated the practical utility of the design space model. Preliminary results indicate that the new design options are technically feasible and have potential applications in vision impairment compensation and extension.

• Limitations and Future Directions:

  • This study does not provide comprehensive performance evaluations of new design options through actual user studies.
  • Currently focused primarily on the visual domain, future work could extend to multimodal design spaces, including other sensory augmentations (e.g., haptics, olfaction).
  • Further refinement of the design space is possible in addressing the complexity of interactions between the human visual system and cognitive abilities.