Virtual Body Swapping: A VR-Based Approach to Embodied Third-Person Self-Processing in Mind-Body Therapy

Title of the Paper

Virtual Body Swapping: A VR-Based Approach to Embodied Third-Person Self-Processing in Mind-Body Therapy

Paper Information

• Subject Area: Application of virtual reality technology in psychotherapy, particularly in self-processing and body awareness research
• Keywords: Virtual reality, body awareness, self-compassion, body swapping, perspective-taking, psychotherapy

Research Background and Problem

• What problems or challenges did the authors identify?

  • How to achieve self-processing and perspective-taking through virtual reality technology in mind-body therapy remains an open research question.
  • Most studies focus on the embodiment of a single avatar, while research on simultaneous or sequential embodiment of multiple avatars and their impact on self-perception is limited.
  • The use of perspective-taking in psychotherapy with virtual reality requires further exploration regarding its effects on different variables (e.g., self-compassion and interoception).

• Why is this problem important?

  • The rise in psychological disorders and the limitations of traditional pharmacological treatments have driven researchers to seek innovative therapies based on mind-body connections.
  • Perspective-taking methods are widely regarded as beneficial for self-reflection and mental health in psychotherapy, but how to optimize these methods using virtual reality remains unresolved.
  • Cognitive dimensions of self-related processing (e.g., self-compassion) and bodily awareness dimensions (e.g., interoception) may significantly influence psychotherapy outcomes.

• Research Motivation and Related Work

  • In recent years, virtual reality has demonstrated its potential in the field of mental health. For example, studies have shown that virtual self-dialogues (e.g., body-swapping with "Freud") can increase self-distancing and improve related mental health indicators.
  • By altering first-person and third-person perspectives, virtual reality can influence the degree of embodiment and the achievement of certain therapeutic goals.
  • The authors aim to study the impact of virtual body-swapping scenarios on users' self-related processing to fill gaps in the existing literature.

Solution

• What methods or solutions did the authors propose?

  • Developed a multi-user virtual reality system that supports real-time body swapping, allowing users to switch perspectives between different personalized and non-personalized avatars.
  • Experimental scenarios include the embodiment of personalized avatars, body-swapping with a stranger, and engaging in self-compassion meditation after the swap.

• What are the innovative aspects of this solution?

  • For the first time, combined multiple avatar embodiment with real-time body swapping and quantitatively analyzed its impact on multiple self-related processing variables (e.g., body awareness, self-compassion).
  • Innovatively leveraged highly realistic personalized avatars to enhance the studied sense of embodiment (SoE).

• What are the implementation steps? What key technologies were used?

  1. Avatar Generation: Used multi-angle photo capture technology to generate highly realistic personalized avatars.
  2. Virtual Environment: Built a virtual room environment tailored to the experimental needs.
  3. System Hardware and Software:
     • Utilized Valve Index headsets and controllers with an efficient tracking system (including markerless tracking and Unity integration plugins).
     • Achieved remote data transmission via network to synchronize user movements.
  4. Body-Swapping Mechanism: Used a handshake to trigger the swapping process, recalibrating the user's position and avatar control permissions in the virtual environment after the swap.
  5. Experimental Procedure: Provided standardized tasks, including embodiment tasks, meditation tasks, and survey responses.

Research Results

• What specific results were achieved?

  • Body Perception: After leaving the first-person perspective, users experienced a reduction in control and self-location sense over the personalized avatar, but self-identification (e.g., body ownership) remained largely intact.
  • Interoception: After body-swapping, users showed a slight increase in attention to bodily signals and a decrease in attention to visible signals.
  • Self-Compassion: Although the experiment did not significantly alter users' self-compassion states, the meditation task elicited positive emotional responses in some users.

• What are the advantages compared to existing solutions?

  • Proposed an innovative virtual reality-based method to achieve complex body-swapping and perspective-taking.
  • Combined personalized avatars with real-time interaction, enhancing the interpretability of experimental results and the applicability of future designs.

• What were the experimental or evaluation results?

  • Quantitative data indicated that body-swapping significantly influenced different dimensions of users' sense of embodiment (SoE).
  • Semi-structured interviews further revealed users' experiences, including feedback on component design and suggestions for improvement.

• Limitations and Future Directions

  • Limitations: Small and homogeneous sample size (young, healthy university students); technical latency affecting user experience; certain key behavioral variables were not measured.
  • Future Directions:
    • Investigate potential impacts on broader populations, particularly therapeutic target groups such as individuals with anxiety or body image disorders.
    • Explore the design of different swapped avatars and their effects on user experience and therapeutic outcomes, such as increasing avatar diversity or setting specific tasks.
    • Further optimize the interactivity and user acceptance of the meditation task.
    • Address social dynamics and privacy issues involved in body-swapping.