From Tactile to NavTile: Opportunities and Challenges for Multi-Modal Feedback in Guiding Surfaces during Non-Visual Navigation

Document Title

From Tactile to NavTile: Opportunities and Challenges with Multi-Modal Feedback for Guiding Surfaces during Non-Visual Navigation

Document Information

• Subject Area: Accessible Human-Computer Interaction and Non-Visual Navigation Technologies
• Keywords: Navigation, Tactile Feedback, Blindness, Low Vision, Textured Surfaces, Mobility, Multi-Modal Feedback, Usability

Research Background and Issues

• Identified Problems or Challenges:

  • Despite existing standards for tactile guiding surfaces, issues persist in their implementation, perception, and geographic localization.
  • Natural tactile cues in the environment are often discontinuous and unreliable, while specially designed tactile surfaces are frequently difficult to detect due to weather conditions (e.g., mud or snow).
  • Current tactile guiding surfaces significantly lack the ability to assist users in geographic localization, such as indicating the distance to the final destination or the direction of terrain.

• Importance of the Problem:

  • Tactile cues are indispensable sensory signals for non-visual navigation. Effective tactile design can help blind and low-vision individuals travel more safely and independently.
  • Poorly designed or implemented tactile surfaces may mislead users and even pose safety risks.

• Research Motivation and Related Work:

  • Existing studies indicate that multi-modal feedback (e.g., combining tactile with audio or vibration) can significantly improve navigation experiences.
  • Through literature review and user studies, the authors identified the technical potential for improving tactile surfaces and the shortcomings in current design implementations.

Proposed Solution

• Proposed Methods or Solutions:

  • Introduce textured surfaces with integrated multi-modal feedback functionalities (referred to as "NavTiles"), combining tactile with audio or vibration cues for non-visual navigation.
  • Based on user research and expert interviews, propose a set of design guidelines and develop a low-cost, multifunctional prototype system that supports the rapid generation of guiding surfaces with various materials and functionalities.

• Innovative Contributions:

  • Propose an open, low-cost prototyping method that enables educators and accessibility designers to quickly experiment with and optimize tactile surface designs.
  • Provide customizable multi-modal feedback features to prevent user information overload while addressing the needs of deafblind individuals.
  • Suggest the development of a planning application to document the layout of guiding surfaces, collect user feedback, and support subsequent adjustments and operations.

• Implementation Steps and Key Technologies:

  1. User Research and Needs Analysis: Surveyed 67 visually impaired users and 10 accessibility experts to gather their attitudes and suggestions for improving tactile surfaces.
  2. Design Iteration: Used desktop 3D printers to rapidly produce tactile textured surfaces and tested the suitability of materials and textures.
  3. Sensor Integration: Embedded low-cost pressure sensors to detect users' gait and trigger audio feedback.
  4. Network Connectivity and Audio Prompts: Developed a backend system to support the transmission of audio information to users' smartphones via network connections.

Research Outcomes

• Specific Outcomes:

  • Gathered feedback on the current usage and issues of tactile surfaces, clarifying directions for improvement and user needs for multi-modal feedback.
  • Developed a prototype system (NavTiles) capable of rapidly customizing tactile textures and integrating interactive functionalities.

• Advantages Compared to Existing Solutions:

  • The low-cost production model makes the design more flexible and easier to promote.
  • Supports multi-modal feedback, enhancing navigation effectiveness and safety through audio and tactile cues.
  • Improves the mobility and adaptability of guiding surfaces by incorporating user input and environmental changes.

• Experimental or Evaluation Results:

  • Users expressed a clear demand for multi-modal feedback, especially in complex public transit stations and mixed-use areas.
  • Experiments validated the effectiveness of pressure sensors and network connectivity in generating real-time audio prompts.

• Limitations and Future Directions:

  • Limitations:
    • Inconsistent implementation of existing tactile surface standards may lead to potential misunderstandings of multi-modal feedback functionalities.
    • Field testing of the prototype design requires further validation.
  • Future Directions:
    • Collaborate with materials engineers and policymakers to establish new standards encompassing multi-modal feedback.
    • Expand the technology to more complex real-world scenarios, such as temporary street layouts or large transportation hubs.
    • Further explore ways to reduce the cognitive load of multi-modal feedback while enhancing user experience and learning capabilities.

This document provides clear directions and practical solutions for improving non-visual navigation while emphasizing the importance of various components within the accessibility design ecosystem.