An Emotion Translator: Speculative Design By Neurodiverse Dyads

Title of the Paper

An Emotion Translator: Speculative Design By Neurodiverse Dyads

Paper Information

• Subject Area: Human-Computer Interaction (HCI), Affective Computing, Neurodiversity Studies
• Keywords: Emotion Translation, Speculative Design, Affective Computing, Autism, Accessibility, Graphical Encoding, Participatory Design, Communication Technology, Human-Computer Interaction, Visual Perception

Research Background and Problem

• Issues and Challenges:

  • Individuals with autism face challenges in social and emotional interactions, as their ways of expressing and interpreting emotions often deviate from conventional norms.
  • Existing technologies for understanding emotions are limited to facial expressions and basic emotion classification, failing to address the complex emotional needs of neurodiverse individuals.
  • Emotional communication can lead to additional cognitive burdens due to misunderstandings and societal biases.

• Significance of the Research:

  • Individuals with autism often experience emotional and social disconnection, which may further lead to social isolation and employment barriers.
  • Enhancing the accurate transmission of emotional information is crucial for fostering mutual understanding and reducing misunderstandings.
  • Emotion translation technologies have the potential to provide neurodiverse individuals with greater freedom of expression and to promote interaction between neurodiverse and neurotypical groups.

• Research Motivation and Related Work:

  • The autism research community seeks more insights into their own and others' emotional experiences to better navigate interpersonal relationships.
  • Existing technologies, such as tools using emojis or facial recognition, aid in emotion recognition and expression but still have limitations in expressive capacity.
  • Current design methods emphasize user participation but have not extensively explored the role of speculative design in facilitating emotional communication.

Solution

• Proposed Method and Innovation:

  • The authors propose a speculative design concept: a prototype of an emotion translation technology that includes an emotion icon matrix and an online chat interface.
  • They advocate for a personalized emotion classification approach, enabling each user to express emotions based on their own "emotional language."
  • Using low-fidelity prototypes and the "Wizard of Oz" technique, the system translates the emotional icons of individuals with autism into forms understandable by their conversational partners.

• Implementation Steps and Key Technologies:

  1. Develop a personalized emotion icon matrix interface, allowing users to select visual icons that align with their emotional expressions.
  2. Build a low-fidelity chat application prototype using Google Slides, enabling communication through text and visual icons.
  3. Employ the "Wizard of Oz" technique, where researchers manually implement the icon translation functionality in the background.
  4. Conduct design discussions via Zoom meetings, involving autistic users and their trusted conversational partners to collaboratively optimize the design.

Research Outcomes

• Specific Results:

  • Developed an initial prototype of an emotion translator that allows users to select and share customized icons based on their emotional states.
  • Autistic participants modified the prototype's layout, labels, and icon selection, demonstrating the diversity of emotional expressions in practice.
  • Explored how emotion visualization-based dialogue could facilitate mutual understanding and meaning negotiation between participants.

• Advantages and Contributions:

  • Provided an innovative framework that supports both neurodiverse and neurotypical users in expressing and understanding emotions during conversations.
  • Highlighted the importance of user participation in the design process and the delicate balance between structure and flexible design.
  • Encouraged participants to creatively engage with the technology to express unique emotional experiences.

• Experimental Results and Limitations:

  • Users actively participated and acknowledged the potential of the technology concept to enhance emotional expression, while also expressing concerns about the risk of misunderstandings.
  • Some participants expressed distrust in AI-based emotion recognition features, emphasizing the need for transparency and user control over the technology.
  • The prototype remains limited to low-fidelity simulations, requiring further development into high-fidelity prototypes suitable for broader user groups.

• Future Directions:

  1. Deepen research on supporting neurodiverse groups, exploring diverse methods of emotional expression and communication.
  2. Develop higher-fidelity image encoding systems and applications that better meet users' practical needs.
  3. Investigate the potential of this technology in other application scenarios, such as non-verbal communication, education, or larger social groups.
  4. Integrate emotion translation technology with other non-invasive AI technologies to enhance its practicality and user acceptance.

This paper provides significant insights into the fields of affective computing and neurodiversity design, showcasing the potential of speculative design in advancing interactive technologies.