Touching the Moon: Leveraging Passive Haptics, Embodiment and Presence for Operational Assessments in Virtual Reality

Title of the Paper

Touching the Moon: Leveraging Passive Haptics, Embodiment and Presence for Operational Assessments in Virtual Reality

Paper Information

• Subject Area: Application of virtual reality technology in operational assessments for space missions
• Keywords: Virtual reality, embodiment, presence, situational assessment, concepts of operations, space exploration, passive haptic feedback

Research Background and Issues

• Problems and Challenges:

  1. Current operational assessments for space mission Concepts of Operations (ConOps) traditionally rely on costly and complex physical simulation facilities.
  2. While virtual reality (VR) offers a more economical and convenient alternative, its reliance on purely visual and auditory simulation has limitations, particularly the lack of haptic feedback, which raises concerns about its realism and effectiveness.
  3. Existing research indicates that embodiment and presence are critical for enhancing the realism of VR simulations, yet their application in operational assessments remains underexplored.

• Significance of the Research:

  • Future lunar missions require the pre-assessment and optimization of numerous manual workflows, such as surface structure deployment and equipment operations. If VR can address the shortcomings of current methods, it will significantly advance the planning and execution of cutting-edge space exploration missions.

• Research Motivation:

  • To explore the role of passive haptic interfaces (e.g., simulated equipment props and astronaut gloves) in enhancing realism and user experience during operational assessments in VR.
  • To investigate the effectiveness of VR, augmented with passive haptic simulation, in supporting operational concept evaluations, particularly in the context of the Apollo 12 mission.

Solution

• Methods and Solutions:

  1. Enhance the physical realism of VR simulations through passive haptic interfaces, such as medium-to-low fidelity physical props and astronaut gloves.
  2. Recreate the lunar experimental deployment scenario of the Apollo 12 mission, including equipment retrieval, assembly, and transportation tasks.
  3. Conduct systematic testing with participants, including experienced astronauts and space industry experts, using a mixed experimental design.

• Innovations:

  • Integration of medium-to-low fidelity passive haptic props (e.g., replicas of Apollo equipment) with real astronaut gloves to simulate gripping and carrying tasks in VR environments.
  • First-ever comparison of Apollo 12 astronauts' operational feedback with qualitative and quantitative evaluations provided by modern experts in VR.

• Implementation Steps:

  1. Develop a high-fidelity lunar virtual environment based on Unreal Engine 4, incorporating NASA's real terrain data and lighting parameters.
  2. Create interactive task proxies, including realistic physical models (e.g., a simulated equipment prop weighing approximately 27 kg) and visual feedback.
  3. Design a mixed experiment to test the impact of glove (with/without) and physical prop (with/without) combinations on participants' experiences.
  4. Collect and analyze subjective questionnaire data (e.g., presence, embodiment, task load) and qualitative feedback.

Research Findings

• Specific Findings:

  1. Increased Presence: The realism of the virtual environment significantly improved under conditions involving gloves, particularly when gloves were combined with physical props, further enhancing the sense of presence.
  2. Enhanced Embodiment: The use of gloves increased participants' sense of body ownership in the virtual body, effectively improving the realism of the simulation.
  3. Consistency in Task Assessment: The combination of gloves and props elicited effective feedback from participants, which closely aligned with the actual feedback provided by Apollo 12 astronauts.
  4. Efficiency and Cost-effectiveness: The new approach significantly reduced the cost and complexity of operational concept assessments while maintaining cognitive reliability.

• Comparative Advantages of the Experiment:

  • Compared to traditional physical simulation facilities, the VR setup combined with haptic simulation demonstrated advantages in terms of time and cost efficiency.
  • It improved the fidelity of the environment and operations while increasing the usability of participant feedback.

• Key Limitations and Future Directions:

  1. Hardware Limitations: The astronaut gloves used in the study did not fully simulate the pressurized conditions of real gloves, potentially underestimating the actual challenges of the tasks.
  2. Environmental Conditions: The study did not fully replicate extreme lighting or lunar polar region conditions that may be encountered in future real missions.
  3. Suggestions for Future Research:
     • Explore new haptic feedback technologies, such as fingertip tracking and hybrid feedback.
     • Multidisciplinary integration: Combine pseudo-haptic algorithms or redirection haptics to enhance physical immersion.
     • Conduct in-depth one-to-one comparisons between VR simulations and real-world scenarios to validate their applicability in operational assessments across more domains.

Through this study, the authors successfully demonstrated the critical role of passive haptics in enhancing the fidelity and usability of VR simulations, providing new insights and technical foundations for using VR technology in space mission planning.