Emotion-aware Design in Automobiles: Embracing Technology Advancements to Enhance Human-vehicle Interaction

Research Background and Issues

• Issues and Challenges:
  The authors point out that although emotion recognition systems in vehicles can significantly improve user experience and safety, there remains a gap between technology-driven approaches and user needs in current practical applications. Many emotion-related technologies are developed primarily in laboratory environments without fully considering users' real-world needs. Additionally, challenges such as accurately defining emotions, classifying emotional states, and leveraging emotion data to provide effective design feedback remain unresolved.

• Importance:
  Emotional states influence drivers' efficiency and road safety. Integrating emotion recognition functionality into vehicle design is key to realizing the next generation of intelligent cockpits. This functionality not only helps regulate users' emotions but also enhances user experience through personalized services, potentially becoming a critical factor in the acceptance of future autonomous vehicles.

• Motivation and Related Work:
  Current research primarily focuses on the impact of emotions on driving (e.g., addressing anger or anxiety) and using human-computer interaction to regulate emotions. However, there is a lack of exploration into how emotion recognition systems can be implemented in design practice. This study aims to advance the boundaries of emotion-driven design in human-computer interaction.

Solution

• Method:
  The authors conducted online interviews with 31 designers, engineers, and AI experts to investigate how emotion recognition functionality is understood and implemented during the early design and optimization phases of intelligent cockpits. The study adhered to user-centered design principles and reflected on emotion recognition system case studies.

• Innovative Contributions:
  This research approaches emotion recognition design by organically combining technological implementation with user needs, while extending the potential of AI technologies to emotion prediction, feedback mechanisms, and proactive services.

• Implementation Steps and Key Technologies:

  1. Scenario Definition and User Needs Exploration:
     • Define emotional scenarios based on user-vehicle interaction data (e.g., driver anxiety during traffic congestion).
     • Use prototype testing and virtual evaluation tools (e.g., VR/AR) to simulate and test designs.
  2. Role of AI:
     • Build AI models to recognize emotions using multimodal sensors (e.g., voice, facial expressions, heart rate).
     • Predict user behavior based on emotion data and automatically adjust scenarios accordingly.
  3. Emotion Feedback Mechanism:
     • Implement interactive in-vehicle experiences through voice assistants, virtual characters, and personalized content feedback.

Research Outcomes

• Specific Findings:

  1. Summarized user-centered principles in emotion recognition system design, including scenario definition, touchpoint analysis, and inclusive design.
  2. Clarified AI's role in emotion recognition systems, encompassing emotion classification, behavior prediction, and interaction feedback.
  3. Identified challenges and opportunities, such as prioritizing safety, addressing privacy concerns, and balancing user experience trade-offs.

• Comparison with Existing Solutions:
  The key advantage of this study lies in its focus on the practical implementation of emotion recognition in design rather than solely on technological innovation. It emphasizes balancing user needs with commercial value.

• Experimental or Evaluation Results:
  The study highlighted issues such as insufficient emotion classification (e.g., difficulty distinguishing genuine smiles from fake ones) and the technical limitations in emotion-driven scenarios. Designers reflected on existing solutions and proposed methods that better align with real-world needs.

• Limitations and Future Directions:

  • Limitations:
    • The study primarily emphasizes breadth, lacking in-depth analysis of specific functionalities or user groups.
    • The sample is predominantly from the perspective of designers, not fully covering the views of engineers or AI experts.
  • Future Directions:
    • Conduct in-depth research on specific scenarios or user groups (e.g., female drivers or elderly passengers).
    • Explore the collaborative relationship between users and AI in emotion recognition.
    • Develop standardized emotion evaluation frameworks to provide systematic guidance for designers and engineers.

Conclusion

This study not only reveals the potential of emotion recognition to enhance user experience in intelligent cockpits but also systematically explores pain points and improvement pathways in design practice. Future research should aim to establish stronger collaboration between user needs and technological feasibility while achieving a better balance between personalization and generalization.