Social Simulation for Everyday Self-Care: Design Insights from Leveraging VR, AR, and LLMs for Practicing Stress Relief

Research Background and Issues

• Issues or Challenges:
  The authors identify that stress in daily life is pervasive, yet many individuals lack effective self-relief methods, especially in the absence of professional or peer support. Social stress and anxiety are significant sub-issues, with many people exhibiting noticeable stress when facing public situations or interpersonal conflicts.

• Significance:
  Social stress not only affects an individual's emotional state but can also disrupt their functioning within family, social circles, and professional environments. Although digital mental health resources are increasingly accessible, people often cannot access these resources at critical moments, leading to a lack of stress management skills and intervention methods.

• Research Motivation and Related Work:
  Existing mental health technologies primarily focus on therapeutic interventions, such as online cognitive behavioral therapy or community support, but lack tools to help users practice immediate stress relief skills. The authors propose that social simulation technology—a method of simulating real-world behaviors and social scenarios in virtual environments—can provide individuals with a safe space to practice stress management skills.

Solution

• Method or Solution:
  The authors propose a social simulation system based on Virtual Reality (VR), Augmented Reality (AR), and Large Language Models (LLMs) to help individuals practice stress management skills. They developed eight interactive prototypes across three everyday social stress scenarios, including public speaking Q&A, social gatherings, and interpersonal conflicts, integrating mental health guidance such as breathing exercises.

• Innovations:

  1. Cross-Technology Integration: This study combines immersive technologies (VR/AR) with generative dialogue (LLMs), leveraging the strengths of both for stress management practice. This technological combination has not been widely applied in the mental health field.
  2. Contextualized Self-Care Practices: Unlike previous research focusing on stress identification and long-term interventions, this study emphasizes providing practical scenarios to help users practice immediate stress relief skills.
  3. User Agency: By allowing manual control of mental health guidance, users can autonomously decide whether to activate breathing guidance based on their actual needs, enhancing self-regulation capabilities.

• Implementation Steps:

  1. Develop three core scenarios related to social stress and design eight prototypes to test different dimensions (e.g., interactivity, immersion, mental health guidance).
  2. Conduct semi-structured interviews with 19 participants to evaluate the quality of the prototypes and gather user feedback.
  3. Analyze user data, extract themes, and propose design recommendations.

Research Outcomes

• Specific Outcomes:

  1. Participants generally perceived the system as having the potential to help them manage stress and expressed high interest in VR and AR technologies.
  2. The results indicate that these simulated scenarios can help users build confidence and practice stress-coping skills in a safe environment, particularly when facing social or interpersonal stress.
  3. The breathing guidance feature of the system received positive feedback from participants, who found it helpful for emotional regulation and enhancing productive responses.

• Advantages and Comparisons:
  Compared to static mental health guidance or escapist virtual environments (e.g., forests or beaches), this system is more grounded in reality, allowing users to practice transferable skills. Additionally, AR technology, due to its integration with real-world environments, was considered superior in helping users directly apply learned skills.

• Experimental or Evaluation Results:
  Prototype evaluations revealed:

  • While participants expressed a clear preference for immersive interactivity, even low-immersion text-based interaction modes were deemed acceptable and valuable.
  • AR scenarios were considered most suitable for everyday applications due to their integration with real environments.
  • Participants raised potential issues with GPT-generated dialogues, such as overly polite interactions that felt unrealistic.

• Limitations and Future Directions:
  Limitations:

  • The study's participants skewed younger, potentially not fully reflecting the needs of older populations.
  • The research did not quantitatively evaluate the simulation technology, leaving the long-term effectiveness for actual stress relief unknown.
  • High-immersion technologies may evoke trauma-like experiences similar to real stress, necessitating personalized and safety-focused settings to mitigate this risk.

  Future Directions:

  • Explore the integration of biofeedback, such as heart rate or skin conductance monitoring, to dynamically adjust breathing guidance or simulation intensity.
  • Develop user customization features, allowing users to adjust simulation scenarios, including environmental settings, interaction difficulty, and mental health guidance content.
  • Apply the system in clinical interventions, enabling mental health professionals to observe patients' responses to stress in simulations and provide more targeted advice and treatment plans.

This study provides strong insights into the development and design of social stress management technologies using VR, AR, and LLMs, while also highlighting ethical concerns and practical needs for future research.