Experiencing Simulated Confrontations in Virtual Reality

Title of the Paper

Experiencing Simulated Confrontations in Virtual Reality

Paper Information

• Subject Area: Virtual Reality Technology and Human-Computer Interaction
• Keywords: Virtual Reality, Confrontational Behavior, Virtual Characters, User Experience, Anxiety Response, Presence, Credibility, Training Applications, Motion Capture, Immersive Experience

Research Background and Problem

• Identified Issues and Challenges: Virtual Reality (VR) holds significant potential for simulating challenging or confrontational human behaviors, yet there is a lack of research on users' emotional responses to confrontational virtual characters and whether VR can elicit more realistic emotional reactions compared to two-dimensional screens (2D). Additionally, designing credible confrontational simulations remains a challenge.

• Importance of the Problem: This research is crucial for enhancing the realism and authenticity of training applications, such as helping doctors handle difficult patient interactions or providing practical training for other professional scenarios.

• Research Motivation and Related Work: Although previous studies have shown that VR can elicit emotional responses in users and has potential for realistic confrontation behavior simulation, there is limited research comparing the intensity of emotional responses between VR and 2D platforms, as well as the factors influencing scenario credibility. This study aims to fill these research gaps.

Solution

• Research Method: A comparative study was designed involving two experimental conditions: one group of participants experienced confrontational behavior in immersive VR, while the other group experienced the same simulation on a 2D screen. Motion capture technology was used to generate the virtual character's behavior, creating experimental scenarios based on real observed behaviors.

• Research Innovations:

  1. Proposed a novel experimental design comparing users' emotional responses to virtual confrontational behavior across VR and 2D platforms.
  2. Explored factors influencing the credibility of virtual character behavior, including performance, visual effects, and interactivity.
  3. Introduced a gambling shop hypothetical scenario, utilizing multidisciplinary knowledge and motion capture technology to generate highly realistic behavior simulations.

• Implementation Steps and Key Technologies:

  1. Scenario Construction: Simulated the layout and realistic behaviors of a British gambling shop in a virtual environment.
  2. Character Performance Design: Used Motion Capture and Unity3D to create confrontational character behaviors, adding facial expressions with Lip-Synch Pro software.
  3. Experimental Design:
     • Participants in two groups experienced either immersive VR via HTC Vive Pro or a 2D display platform for comparison.
     • Anxiety and presence were assessed using the State Trait Anxiety Inventory (STAI) and ITC Sense of Presence Inventory (ITC-SOPI) scales, supplemented by semi-structured interviews for qualitative feedback.

Research Results

• Specific Findings:

  1. Emotional Activation:
     • Anxiety levels under VR conditions were significantly higher than under 2D conditions (supporting hypotheses H1 and H2).
     • Increased anxiety in VR conditions was positively correlated with evaluations of "physical spatial presence."
  2. Presence:
     • VR users reported higher levels of physical spatial presence, immersion, and ecological validity, without reporting higher negative effects (supporting hypotheses H3 and H4).
  3. Character Credibility:
     • Users generally found the character's behavior credible, particularly the emotional buildup that aligned with real-life experiences.
     • Visual effects and animation errors diminished credibility for some users.

• Advantages Compared to Existing Solutions:

  • This study constructed character behaviors based on motion capture, integrating real-world scenario behaviors and multidisciplinary knowledge, significantly enhancing behavioral realism.
  • Provided evidence supporting VR's stronger emotional activation potential compared to 2D, offering a basis for training applications.

• Experimental or Evaluation Results:

  • Data from 68 participants validated VR's advantages in confrontational scenarios.
  • Qualitative feedback from participants revealed that improving animation details and interactivity could further enhance the experience.

• Limitations and Future Directions:

  • Limitations: The current experiment did not directly compare VR with real-world confrontational scenarios, had limited interactivity in the virtual environment, and involved relatively short simulation durations.
  • Future Directions:
    1. Investigate comparisons between VR and real-world confrontational behaviors.
    2. Optimize character interactivity by incorporating real-time AI technologies to enhance performance.
    3. Extend the study to longer and more complex scenarios to evaluate effectiveness in specific training applications.

Conclusion

This study demonstrates the advantages of VR in simulating challenging confrontational scenarios, particularly for training and educational applications. By leveraging multidisciplinary expertise and virtual technology, the research showcases how immersive VR can elicit realistic emotional responses while exploring effective methods to enhance the credibility of virtual character behaviors. Future studies can further refine interaction design and expand applications across various domains.