Lights, Camera, Access: A Closeup on Audiovisual Media Accessibility and Aphasia

Title of the Paper

Lights, Camera, Access: A Closeup on Audiovisual Media Accessibility and Aphasia

Paper Information

• Research Area: Human-Computer Interaction (HCI), Accessibility Technology, Multimedia Assistive Design
• Keywords: Accessibility, Audiovisual Media, Aphasia, Complex Communication Needs (CCNs), Technological Intervention, Cognitive Load, Subtitles, Custom Design

Research Background and Issues

• Issues and Challenges:

  1. Audiovisual media is increasingly important in modern society, yet access remains challenging for people with disabilities, particularly those with complex communication needs.
  2. Most accessibility technology research focuses on visually impaired (BVI) or hearing impaired (DHH) groups, with limited studies addressing the specific accessibility needs of individuals with complex communication needs (CCNs).
  3. For individuals with aphasia, existing technologies such as subtitles have limited effectiveness in improving comprehension, and there is a lack of detailed data on the specific barriers faced during media consumption.

• Significance: Audiovisual media is not only a crucial channel for entertainment and social interaction but also essential for cultural participation, information access, and engagement in democratic processes. Ensuring equitable and safe access to such content for everyone holds significant societal value.

• Research Motivation: To build a deeper understanding of audiovisual habits and access barriers for individuals with aphasia, providing guidance for future accessibility technology design.

• Related Work:

  1. Existing research largely focuses on subtitles and audio descriptions but does not adequately explore their practical effectiveness for individuals with language impairments such as aphasia.
  2. There is a general lack of participatory design involving individuals with complex communication needs, with less than 10% of related studies adopting such methods.

Proposed Solution

• Research Methods:

  1. Conducting the first study on audiovisual media consumption experiences for individuals with aphasia and CCNs:
     • Online survey (N=41)
     • Two focus group discussions (N=10)
  2. Developing a classification framework for barriers and facilitators in the viewing experience.

• Innovative Contributions:

  1. Providing the first systematic research data on the viewing experiences of individuals with aphasia.
  2. Innovatively exploring how accessibility technologies can be tailored to the characteristics of the aphasia population, proposing more flexible design concepts (e.g., personalized content optimization).

• Implementation Steps and Techniques:

  1. Online Survey:
     • Improved questionnaire design using images and segmented sections to enhance engagement;
     • Collecting data on device usage habits, language impairments, and self-reported audiovisual experiences.
  2. Focus Group Discussions:
     • Utilizing paper-based tools (e.g., paper Likert scales) and speech-language therapists (SLTs) to facilitate interaction;
     • Combining media clips with viewing and commentary activities to explore specific issues across various audiovisual scenarios.

Research Findings

• Specific Results:

  1. Key Findings:
     • Aphasia significantly reduces overall viewing experience of audiovisual content (from 4.55/5 to 2.83/5, a 34.6% decrease).
     • Subtitle reading is the most affected aspect, with reading difficulty increasing by 40%.
  2. A classification framework for barriers and facilitators in audiovisual media accessibility was developed, encompassing four core themes:
     • Language comprehension, cognitive load, screen text and subtitles, narrative following.
  3. Technical recommendations:
     • Addressing issues through personalized design (e.g., adjusting subtitle speed, providing interactive content explanation features).
     • Leveraging Object-Based Media and artificial intelligence technologies to offer personalized adjustment options for users.

• Advantages Compared to Existing Solutions:

  1. Accommodates diverse and complex user needs, surpassing the "one-size-fits-all" approach of current accessibility technologies.
  2. Addresses gaps in cognitive load, text processing, and dynamic adjustment.
  3. Provides greater user customization options, offering flexibility and expansion potential.

• Experimental and Evaluation Results:

  • Statistical results from the online survey indicate that language comprehension significantly impacts viewing experiences.
  • Qualitative data from focus groups show that individuals with aphasia prefer slower-paced, clearly segmented multimedia content.

• Limitations and Future Directions:

  1. The sample primarily consists of English-proficient individuals with mild aphasia, potentially underrepresenting the needs of those with more severe aphasia.
  2. The video clips used were relatively short, limiting the exploration of challenges associated with prolonged viewing.
  3. The sample is confined to Western cultural contexts, restricting the study's applicability to other languages or cultural groups globally.

  Future Work Directions:

  • Investigating technological mechanisms for dynamically adjusting the pace of information presentation.
  • Deepening collaboration with individuals with aphasia and related experts to develop new accessibility technologies through participatory design.
  • Validating new technologies across broader and cross-cultural samples.