TADA: Making Node-link Diagrams Accessible to Blind and Low-Vision People
Honorable MentionAuthors
Title of the Paper
TADA: Making Node-link Diagrams Accessible to Blind and Low-Vision People
Paper Information
- Research Area: Information Visualization and Accessibility Technologies
- Keywords: Node-link diagrams, tactile interaction, assistive technology, visual impairment, voice commands, chart assistance, accessible design, visualization technology, multimodal interaction
Research Background and Problem Statement
- Identified Problem or Challenge: Node-link diagrams (e.g., family trees, organizational charts, mind maps) present significant accessibility challenges for visually impaired individuals due to their nonlinear spatial representation. These diagrams are widely used in textbooks, online resources, and system design, but current technologies and solutions (e.g., image descriptions, OCR tools) often fail to provide deep, multi-perspective access to information.
- Importance: Node-link diagrams are extensively applied in educational, professional, and everyday contexts. Inefficient access to these diagrams can impact the equity and career opportunities of visually impaired individuals and negatively affect fairness in scientific research.
- Research Motivation and Related Work: The authors identified shortcomings in existing solutions (e.g., TeDUB, GeoTablet) in preserving spatial relationships, enabling rich hierarchical information access, and maintaining cost-effectiveness. This motivated the design of an innovative accessible interface to address these needs.
Solution
- Method or Solution: The study proposes a tablet-based interactive system called “TADA” (Touch and Audio-based Diagram Access), which leverages tactile touch, voice commands, and real-time audio feedback to assist visually impaired users in exploring node-link diagrams.
- The system design includes four interaction modes: touch exploration, node search, navigation between nodes, and information filtering.
- Designed to operate on simple, low-cost devices (e.g., tablets) without reliance on expensive specialized hardware.
- Innovative Features:
- Preserves the spatial relationships of diagrams, using tactile and audio cues to build spatial awareness for non-visual users.
- Enables multi-level information interaction (from global overview to detailed extraction), allowing users to select information granularity based on their needs.
- Combines abstract musical tones with voice cues for diagram nodes and connections, providing clear and distinguishable audio feedback.
- Implementation Steps and Key Technologies:
- The system is developed using the Unity game engine and ChucK audio programming language, supporting multi-platform deployment.
- Users can interact with diagrams through a rich set of touch and voice commands (e.g., single-finger swiping, five-finger circular browsing, single-finger quick sliding).
- Audio design assigns distinct tones to nodes and links based on their characteristics (e.g., French horn sounds for nodes, high-pitched tones for highly connected nodes).
Research Outcomes
- Specific Results:
- Developed a multimodal interactive system, TADA, enabling visually impaired individuals to effectively explore node-link diagrams using tactile and audio feedback.
- Proposed the “Diagram Access Ladder,” a model for visually impaired users’ information acquisition ranging from no access to full utilization.
- Delivered statistically validated design interfaces and user interaction techniques.
- Advantages over Existing Solutions:
- Compared to static descriptions (e.g., alt-text) and existing tools, this system offers faster and more efficient multi-level interaction.
- Operates on low-cost devices, reducing hardware dependency, in contrast to expensive multimodal touch display solutions.
- Experimental or Evaluation Results:
- Evaluated by 25 visually impaired users, achieving approximately 88% task completion rate, demonstrating users’ ability to effectively understand spatial layouts and structures.
- Audio design received positive feedback for its distinguishability and interactivity, though some scenarios presented challenges in processing audio information.
- Limitations and Future Directions:
- The current version supports only equidistant links, limiting its ability to display complex diagrams (e.g., directional links or area relationship diagrams).
- Restricted to tablet-sized screens, which may affect performance for large-scale diagrams.
- Expanding modalities (e.g., enhanced tactile feedback or area layout support) could improve its applicability further.
Conclusion and Contributions
This study explores existing accessible diagram technologies and introduces an innovative system prototype for multi-level access to node-link diagrams. Its contributions include:
- Identifying challenges and solution requirements for visually impaired individuals accessing node-link diagrams.
- Providing a set of multimodal interaction techniques successfully applied to accessible diagram exploration.
- Validating the system’s effectiveness through user evaluations and outlining directions for further optimization.
Research Questions / Practical Problems
Question signals indexed for this paper.
Research Questions
3- How can a system be designed to help blind and low-vision users efficiently access node-link diagrams (e.g., family trees, outlines)?Category: Scientific, Cultural, and Domain Data AnalyticsSimilar questionsarrow_forward
- Without expensive hardware, can haptic and audio feedback help users obtain spatial relationships in graphs?Category: Scientific, Cultural, and Domain Data AnalyticsSimilar questionsarrow_forward
- How effective is multi-level interaction (global to detail) in helping blind users explore node-link diagrams?Category: Scientific, Cultural, and Domain Data AnalyticsSimilar questionsarrow_forward
Practical Problems
1- Blind users struggle to access node-link diagrams intuitively, affecting fairness in learning and work.Category: Scientific, Cultural, and Domain Data AnalyticsSimilar questionsarrow_forward
- 100%
A Face Recognition Application for People with Visual Impairments: Understanding Use Beyond the Lab
CHI '18· Visual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)
- 100%
Enabling People with Visual Impairments to Navigate Virtual Reality with a Haptic and Auditory Cane Simulation
CHI '18· Visual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)
- 100%
SteeringWheel: A Locality-Preserving Magnification Interface for Low Vision Web Browsing
CHI '18· Visual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)
- 100%
Caption Crawler: Enabling Reusable Alternative Text Descriptions using Reverse Image Search
CHI '18· Visual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)
- 100%
Exploring the Opportunities for Technologies to Enhance Quality of Life with People who have Experienced Vision Loss
CHI '19· Visual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)
- 100%
LightWrite: Teach Handwriting to The Visually Impaired with A Smartphone
CHI '21· Visual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)
- 100%
Tactile Fixations: A Behavioral Marker on How People with Visual Impairments Explore Raised-line Graphics
CHI '21· Visual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)
- 100%
Accessible Data Representation with Natural Sound
CHI '23· Visual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)
- 100%
ImageAssist: Tools for Enhancing Touchscreen-Based Image Exploration Systems for Blind and Low Vision Users
CHI '23· Visual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)
- 100%
"Explain What a Treemap is": Exploratory Investigation of Strategies for Explaining Unfamiliar Chart to the Blind and Low Vision Users
CHI '23· Visual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)
Based on Jaccard similarity of research subtopics & professions (≥60%)