Beyond Repairing with Electronic Speech: Towards Embodied Communication and Assistive Technology

Title of the Paper

Beyond Repairing with Electronic Speech: Towards Embodied Communication and Assistive Technology

Paper Information

• Subject Area: Assistive Technology Design and Embodiment Theory in Human-Computer Interaction
• Keywords: Assistive Technology, Embodiment, Human-Computer Interaction, Participatory Design, Augmentative and Alternative Communication (AAC)

Research Background and Issues

• Identified Problems or Challenges:

  1. Traditional AAC (Augmentative and Alternative Communication) devices and their designs aim to "fix" user deficiencies, focusing on electronic speech generation while neglecting users' existing autonomous and embodied communication methods.
  2. High abandonment rates of advanced AAC devices and their potential restrictions on users' physical movements and environmental interactions.
  3. Current AAC devices are predominantly centered on electronic tools, relegating non-verbal communication (e.g., gestures, facial expressions) to a secondary role.
  4. Most AAC device designs are based on the widely accepted "medical model," which emphasizes "fixing deficiencies" while overlooking the social, situational, and multi-dimensional aspects of communication.

• Significance:

  1. Embodiment theory emphasizes the central role of the body in cognition and experience, offering critical insights for AAC research and design.
  2. Rethinking the integration of body and technology can mitigate the adverse effects of technology on users' physical and cognitive experiences, improving the efficiency and acceptance of assistive technologies.
  3. Shifting from traditional design perspectives can significantly enhance the real-world impact of assistive technologies, boosting users' confidence and autonomy.

• Research Motivation and Related Work:

  • Critically examining the limitations of existing AAC designs based on theories such as Merleau-Ponty's embodiment theory, the Extended Mind Thesis, and post-embodiment frameworks.
  • Integrating participatory design approaches to explore how design can address users' embodied needs, including the interplay between technology, the environment, physical behavior, and cognition.

Proposed Solutions

• Proposed Solutions and Methods:

  1. Develop an embodiment framework to redefine the relationship between AAC devices and users, emphasizing the synergy between technology, the body, the environment, and cognition.
  2. Employ participatory design methods to co-design AAC devices tailored to individual needs, particularly for patients with speech impairments such as aphasia.

• Innovative Contributions:

  1. Introduce embodiment theory to shift AAC research from focusing on speech generation and symbol processing to broader communication technology support.
  2. Demonstrate how technology can integrate into users' daily lives as an "extension of the body," reducing psychological and social barriers.
  3. Propose AAC as a "safety net for communication" rather than a replacement for users' existing abilities.
  4. Advocate for adjustable and discreet AAC forms to minimize interference or social awkwardness for users.

• Implementation Steps and Key Techniques:

  1. Theoretical Foundation: Use the embodiment framework to map existing issues and propose a more comprehensive perspective on AAC design.
  2. Participatory Design:
     • Conduct 14 co-design workshops with aphasia patients and therapists.
     • Create low-fidelity prototypes (using handcrafted models to explore user needs).
     • Test high-fidelity prototypes (for practical user testing and feedback).
     • Design experiential prototypes and role-playing scenarios (to simulate real-life usage contexts).
  3. Data Sources: Analyze over 25 hours of recorded design sessions, 300 hours of observations and volunteer activities, and detailed field notes.

Research Outcomes

• Achieved Outcomes:

  1. Proposed an embodiment framework to qualitatively explain the communication experiences of aphasia users and their new requirements for AAC design.
  2. Through case studies (narratives of four specific individuals), extracted key insights for AAC design:
     • Communication extends beyond language, encompassing non-verbal signals (gestures, eye contact) and material resources (personal appearance, props).
     • AAC devices should not diminish users' existing communication abilities.
     • Adjustable and discreet AAC forms are better suited to situational needs than traditional technologies.
  3. Proposed new AAC design recommendations: devices should support non-verbal communication, encourage users to leverage existing abilities, and dynamically adapt to their environments.

• Advantages Compared to Existing Solutions:

  1. Traditional AAC devices often focus on speech generation while neglecting users' non-verbal communication; this embodiment framework addresses that gap.
  2. Encourages participatory co-creation and experiential design, significantly improving user acceptance and contextual adaptability of the technology.
  3. Respects users' individuality and cultural backgrounds, avoiding mandatory and standardized "fixation" design concepts.

• Experimental or Evaluation Results:

  1. Successfully co-designed a series of new devices addressing different communication challenges (e.g., AAC smartwatches, badges).
  2. Users highly praised the participatory nature of the design process and the devices' support for their daily communication needs.
  3. Feedback within the parameterized analysis framework clearly identified core pain points of traditional AAC devices (e.g., embarrassment in public settings, usability issues).

• Limitations and Future Directions:

  1. The current research primarily relies on qualitative analysis, lacking quantitative validation of the embodiment framework.
  2. The case studies involve a limited sample size, necessitating broader audience coverage, especially across different cultural backgrounds and age groups.
  3. Future research should focus on the potential "disembodiment" risks of emerging technologies (e.g., AI speech, wearable technology) while exploring how to intuitively support users' communication intentions.