Infosonics: Accessible Infographics for People who are Blind using Sonification and Voice

Title of the Paper

Infosonics: Accessible Infographics for People who are Blind using Sonification and Voice

Paper Information

• Subject Area: Accessibility Technology and Human-Computer Interaction Design
• Keywords: Blind, Low Vision, Information Access, Accessible Infographics, Sonification

Research Background and Problem

• Identified Problems or Challenges:

  • Data visualizations (e.g., charts and infographics) widely used in news reporting are significantly inaccessible to blind and low vision (BLV) individuals.
  • Traditional assistive methods, such as text descriptions or tactile graphics, have limitations, such as the inability to present detailed data or requiring specialized equipment.
  • Sonification (using non-speech sounds to convey data) has been explored as a potential solution but remains difficult to understand, unengaging, and primarily targeted at expert users.

• Importance of the Research:

  • Equal access to information is a fundamental human right and is crucial for independence and social inclusion.
  • Current visual or tactile alternatives fail to fully meet the needs of the BLV community, while sound design may offer a viable alternative.

• Motivation and Related Work:

  • The accessibility of data journalism and online infographics has not been sufficiently addressed.
  • Existing sonification research has primarily focused on functionality, with insufficient attention to aesthetics and user engagement.
  • There is a need to explore sonification styles that are easier to understand and more engaging.

Proposed Solution

• Proposed Method or Solution:

  • Introducing "Infosonics": an interactive "sonic infographic" designed for blind or low vision individuals.
  • Infosonics combines non-speech sounds (data sonification), voice annotations, and engaging sound design to present data in a more comprehensible and appealing way.

• Innovative Aspects:

  • Unlike previous utilitarian sonification designs, Infosonics emphasizes aesthetics and usability, enabling general users to engage without expert knowledge.
  • Includes detailed voice introductions and annotation tracks to provide data context and highlight key points (akin to textual annotations in traditional infographics).
  • Features a simple, user-friendly web interface allowing users to select tracks, adjust speed, and more.

• Implementation Steps and Key Techniques:

  1. Data Sonification: Assigning individual tracks to different datasets and designing specific sound elements (e.g., rhythm, pitch, and stereo positioning).
  2. Voice Introduction: Providing detailed audio guidance to explain datasets and the meaning of sound expressions.
  3. Annotation Tracks: Offering real-time voice guidance on key data points and events.
  4. User Interface:
     • Accessible via standard web browsers.
     • Includes basic functionalities such as play, pause, track selection, and speed control.

Research Outcomes

• Specific Results:

  • Compared to traditional sonification and text descriptions, Infosonics was shown to facilitate clearer mental imagery and was more engaging for general BLV users.
  • Infosonics and text descriptions complement each other: text aids initial understanding, while Infosonics supports independent analysis and enhances engagement.

• Comparison with Existing Solutions and Advantages:

  • Infosonics addresses the shortcomings of utilitarian sonification designs with its aesthetic focus and usability.
  • Offers stronger interactivity (e.g., real-time layered data exploration) and higher user acceptance.

• Experimental or Evaluation Results:

  • The experiment involved 18 BLV participants, comparing Infosonics, traditional sonification, and text descriptions.
  • Infosonics demonstrated superior performance in engagement, mental imagery, and the ability to independently analyze data (e.g., over 90% positive feedback).
  • Most participants expressed willingness to recommend Infosonics to other BLV users and to use it in news and work contexts.

• Limitations and Future Directions:

  • Infosonics is more time-consuming than text descriptions, necessitating further research on optimizing efficiency.
  • Automating the generation of Infosonics is a key area for future research, especially for dynamically changing data (e.g., COVID-19 data).
  • Sonification design needs to balance functionality and aesthetics while exploring ways to incorporate more data tracks without compromising usability.

Conclusion

Infosonics is an innovative sonification design that enhances accessibility by combining aesthetics and usability, providing blind and low vision individuals with a highly engaging method for online information access. Compared to traditional sonification or text descriptions, Infosonics demonstrates significant advantages in mental imagery and user preference. Future research should focus on improving generation efficiency and scalability.