Bittersweet Snapshots of Life: Designing to Address Complex Emotions in a Reminiscence Interaction between Older Adults and a Robot

Research Background and Issues

• Identified Problems and Challenges: The paper identifies that existing reminiscence technologies (especially those designed for older adults) primarily focus on memory stimulation and basic usability, often neglecting the complex emotions users experience during interactions with the technology. Reminiscence frequently involves "bittersweet emotions," which can deepen melancholy or trigger distress, and current technologies lack sensitivity in addressing these emotions. This complexity is particularly pronounced in one-on-one robot interactions, where robots often fail to recognize users' emotional changes.
• Significance: Older adults may more frequently face challenges such as the loss of loved ones or physical abilities, making them particularly emotional during reminiscence processes. Designing technologies that effectively address these complex emotions and avoid adverse psychological impacts on older adults is a critical area of research. This is not only essential for the practical utility of the technology but also involves ethical considerations.
• Research Motivation and Related Work: The authors were inspired by existing research on reminiscence interventions, such as reminiscence therapy and AI robot interventions. Meanwhile, personalized emotional management technologies (e.g., Facebook's "Memories" feature) have revealed deficiencies in emotional support and handling sensitive topics. Therefore, the authors aim to address this gap in managing complex emotions through technology, enabling robots to more sensitively handle the emotional experiences of older users.

Proposed Solution

• Proposed Solution: The authors designed a technology based on photo reminiscence interactions between robots and users, intending to guide users in reflecting on the meaning of life (drawing from the Japanese concept of "ikigai"). Through multi-round interactions between robots and older adults (Study 1) and subsequent co-design workshops (Study 2), they sought to explore how robots can better support users in managing the "bittersweet" emotions elicited by reminiscence.
• Innovations:
  1. Emphasis on managing "bittersweet" emotions, a focus rarely addressed in previous technology designs.
  2. Integration of AI generative language models (GPT-3) with pre-scripted questions to explore and respond to users' inner emotions.
  3. Utilization of co-design methods to directly incorporate feedback from target users (older adults) to refine emotion-sensitive functionalities.
• Implementation Steps:
  1. In the initial user study (Study 1), deploy robots to interact with 20 older adults using photo-based reminiscence and record emotional changes and robot performance.
  2. In the subsequent workshop (Study 2), invite 7 older adults to discuss how to design more appropriate robot response strategies.
  3. Conduct thematic analysis to extract emotional triggers and improvement suggestions from user-robot interactions.

Research Outcomes

• Specific Findings:
  1. Confirmed the prominent role of complex emotions in reminiscence technologies.
  2. Validated that robots can assist in addressing explicitly expressed emotions (e.g., providing comfort during sadness and guiding positive reminiscence) but often struggle with implicit or unarticulated emotions.
  3. Proposed several design recommendations for emotional management, including: adding psychological preparation prompts before interactions, asking users if they are willing to discuss the current topic, and using small markers to record and suggest sharing inner emotions with others.
• Comparison with Existing Solutions:
  1. Unlike previous reminiscence technologies that focused solely on memory stimulation or functionality, this study emphasizes emotional dynamics.
  2. Innovatively combines modern AI technologies (e.g., GPT-3) with the design needs of older users to enhance emotional sensitivity during conversations and interactions.
• Experiment and Evaluation Results:
  1. "Bittersweet" emotions were observed in 74.5% of interaction scenarios, but robots still struggled to fully meet user needs in handling these complex emotions.
  2. Users were more willing to share melancholic memories with robots, partly because robots do not exhibit the "emotional judgment" present in human interactions.
  3. Human intervention was required in cases where robots failed to manage emotions to prevent further emotional discomfort for users.
• Limitations and Future Directions:
  1. Current robots have limited ability to understand implicit emotions, necessitating the future integration of multimodal perception technologies (e.g., emotion recognition sensors).
  2. The study did not fully address the needs of older adults with depression or cognitive impairments, whose requirements may be more complex.
  3. Future research could expand to collective interactions or multi-generational robot-assisted reminiscence activities to explore how to more effectively foster social connections.

Conclusion

This study provides an important perspective: technologies should not only evoke memories but also support and manage the complex emotions that arise during reminiscence. By designing sensitive robot interaction mechanisms, this work lays the foundation for future reminiscence technology designs while emphasizing the importance of ethical considerations. Future directions include optimizing technology to reduce reliance on human supervision and extending this emotion-sensitive approach to more scenarios and user groups.