Choosing the Right Reality: A Comparative Analysis of Tangibility in Immersive Trauma Simulations

Title of the Paper

"Choosing the Right Reality: A Comparative Analysis of Tactile Sensation in Trauma Simulation"

Paper Information

• Subject Area: Human-Computer Interaction (HCI), Medical Training, Virtual Reality and Mixed Reality Technologies
• Keywords: Mixed Reality, Emergency Medical Training, Virtual Reality, Disaster Response, Simulation Training, User Experience, Interaction Design, Technology Acceptance, Social Presence, Self Presence

Research Background and Problem Statement

• Identified Issues or Challenges:

  • Training for emergency medical personnel requires the integration of cognitive, emotional, and tactile skills, such as stress resilience, decision-making, and physical interaction with medical equipment.
  • Traditional training methods (e.g., real-life scenario simulations) are costly and complex to set up, making frequent implementation impractical.
  • While Virtual Reality (VR) excels in immersive decision-making training, it lacks tactile interaction capabilities, failing to fully meet the needs of emergency scenarios.

• Significance of the Research:

  • Effective training of emergency medical personnel is critical for handling complex real-world situations, and finding a more efficient training method can enhance psychological and skill preparedness.
  • Emerging Mixed Reality (MR) technologies may bridge the gap between traditional training and VR, but their practical effectiveness lacks sufficient empirical research support.

• Research Motivation and Related Work:

  • Mixed Reality (MR), which combines physical and digital interactions, has the potential to provide a balanced cognitive and tactile experience. However, comparative studies between MR, VR, and traditional training are scarce, particularly in the field of emergency medical training.
  • The authors developed the "Green Manikin" as a novel MR tool and aimed to empirically compare the effectiveness of three training methods.

Proposed Solution

• Proposed Methods or Solutions:

  • Introduction of the "Green Manikin" System:

    • Combines a real green-screen human mannequin with a virtual environment.
    • Utilizes real medical tools (e.g., tourniquets, stethoscopes, ventilators) to interact with virtual patients in the MR environment.
    • Integrates voice interaction into the system, enabling real-time dialogue and feedback from virtual patients through natural language processing technologies.

  • Experimental Design:

    • Compares MR with standard VR training and role-playing-based real-life simulation training.
    • Evaluates the effectiveness of the three methods from the perspectives of presence and technology acceptance.
    • Collects data using various quantitative and qualitative methods: user-reported scales (e.g., UTAUT2, Presence Scale) and open-ended questions to explore subjective user experiences.

• Innovative Features:

  • Combines full-body virtual integration with the use of actual medical tools, enhancing tactile realism and operational intuitiveness compared to existing methods.
  • Provides a systematic training framework tailored to different training objectives.

• Implementation Steps and Key Technologies:

  • Utilizes LiDAR depth sensing technology and green-screen backgrounds in the MR environment to ensure precise integration of physical tools with virtual objects.
  • Employs virtual agent models (3D virtual patients) to simulate real medical scenarios.
  • Integrates voice recognition (Whisper), natural language generation (ChatGPT), and text-to-speech technologies to simulate interactions with virtual patients.

Research Outcomes

• Specific Findings:

  • Presence:

    • Self Presence: MR and real-life simulation outperformed VR.
    • Social Presence: Real-life simulation scored highest, MR significantly outperformed VR, demonstrating greater interaction authenticity.
    • Physical Presence: MR showed descriptive statistical superiority over VR and real-life simulation, but the difference was not statistically significant.

  • Technology Acceptance:

    • Effort Expectancy: Users found real-life training the easiest to use, but MR's ease of use was close to that of real-life training.
    • VR was inferior to MR and real-life training in terms of intuitiveness and tool interaction.
    • Participants exhibited high behavioral intention toward MR and real-life training, showing positive attitudes.

  • Preferences and Application Scenarios:

    • Participants preferred MR as a comprehensive training method (11/15 chose MR); real-life training remained indispensable in certain scenarios.
    • VR was deemed suitable for organizational and command tasks in large-scale disaster events (e.g., triage).
    • The combination of MR and real-life training was suggested as a long-term methodological approach for training.

• Advantages Over Existing Methods:

  • MR combines the immersive experience of VR with the intuitive physical interaction of real-life training, providing a more realistic and interactive training environment for skill development.

• Experimental or Evaluation Results:

  • Quantitative analysis using Friedman tests revealed statistically significant differences across the three methods in dimensions such as self and social presence, effort expectancy, and ease of use.
  • Qualitative feedback indicated that the MR method was perceived by users as more realistic in reproducing complex medical scenarios.

• Limitations and Future Directions:

  • The sample size of 15 participants limits the statistical generalizability of the results; future research could expand the sample size and cover a broader range of medical scenarios.
  • Explore ways to integrate MR with existing training curricula and conduct longitudinal studies on training outcomes (e.g., skill retention and application in real-world scenarios).
  • Further optimize voice interaction technologies to enhance MR's social presence and improve the quality of interactions between virtual patients and users.

In summary, this study validates the potential of MR in emergency medical training, particularly in immersive and tactile training contexts, providing a practical framework for technological applications in medical education and HCI research.