NavStick: Making Video Games Blind-Accessible via the Ability to Look Around

Title of the Paper

NavStick: Making Video Games Blind-Accessible via the Ability to Look Around

Bibliographic Information

• Research Area: Human-Computer Interaction and Accessibility Technology, specifically assistive technologies for visually impaired individuals in video gaming.
• Keywords: Audio navigation tool, autonomous navigation, accessible gaming, visual impairment, video game assistance

Research Background and Problem Statement

• Identified Problems or Challenges:
  Traditional accessible games designed for visually impaired individuals are often simplified 2D grids or menu-based navigation systems, limiting players' ability to freely explore complex game worlds. This creates a significant gap between their experience and the immersive 3D gaming enjoyed by sighted players. Moreover, mainstream video games lack tools that allow visually impaired players to autonomously "look around" virtual environments.
• Significance:
  Visually impaired players are unable to enjoy the depth and complexity of mainstream 3D games, exacerbating the disparity in gaming experiences between them and sighted players. This raises important challenges for promoting social inclusion and technological equity in the gaming domain.
• Research Motivation and Related Work:
  The authors aim to develop a non-linear, autonomous audio navigation tool that enables visually impaired players to freely explore virtual worlds like sighted players. The paper also reviews the limitations of existing tools, such as menu navigation and GPS navigation, to provide context for designing a new approach.

Proposed Solution

• Proposed Method or Solution:
  The authors propose an audio navigation tool called NavStick, which reimagines the right joystick of a game controller. Players can use a "scrubbing" motion to locate objects based on direction, with spatialized audio feedback providing information about the surrounding environment.
• Innovative Features:
  • Autonomy: Users can scan in any direction at any time without relying on linear menu navigation.
  • Non-Intrusiveness: Audio notifications are provided only when the player actively engages, avoiding excessive and unnecessary audio feedback.
  • Hardware Compatibility: The system requires no additional hardware and works with standard game controllers and headphones.
• Implementation Steps and Technology:
  • NavStick was developed using the Unity game engine, incorporating Steam Audio tools for spatialized audio.
  • The design requirements were determined through a co-design process with visually impaired research team members.
  • A data structure called "NavPie" was developed to represent the location and angle of virtual objects using directional labels.
  • Real-time raycasting technology was integrated to identify objects and provide audio feedback.

Research Outcomes

• Specific Results:
  • Compared to traditional menu-based navigation tools (NavMenu), NavStick enabled players to form more accurate mental maps of their environment.
  • User testing revealed that visually impaired players preferred NavStick's autonomous navigation capabilities, particularly for directional tasks or gaming scenarios.
  • Across eight experimental scenarios, NavStick was effectively applied to complex 3D gaming environments, significantly enhancing the sense of freedom and engagement for visually impaired players.
• Comparison with Existing Solutions and Advantages:
  • Directional Information Advantage: NavStick provides information about the direction and spatial location of objects, unlike menu tools that merely list existing objects.
  • User Experience: Players reported that NavStick gave them the ability to "look around" the game environment, a feature previously unavailable to them.
• Experimental or Evaluation Results:
  • Visually impaired players successfully completed all experimental game tasks, including those in complex dynamic environments (e.g., moving enemies), under time constraints, and with environmental occlusions.
  • Occlusion (obstructive barriers) posed the greatest challenge for players, highlighting the need for improved mechanisms to track dynamic objects and manage time-sensitive scenarios.
• Limitations and Future Directions:
  • The current system supports only planar directional navigation; future work could expand it to spherical navigation.
  • Further research is needed to provide more detailed descriptions of environmental occlusions and to translate visual aesthetic information into audio feedback.
  • NavStick has potential applications in real-world navigation scenarios (e.g., white canes or smartwatches), broadening its scope of use.

Conclusion

This paper introduces and validates NavStick, a novel navigation assistance tool for video games, offering visually impaired players the opportunity to engage with mainstream 3D games. The study demonstrates that NavStick significantly enhances players' ability to explore freely, provides directional information, and improves the overall gaming experience. However, challenges such as handling occlusions and providing aesthetic feedback remain. Future research could further expand its functionality and application areas, including real-world navigation, to offer greater freedom and convenience for visually impaired individuals.