Simulator-based Mixed Reality eVTOL Pilot Training: The Instructor Operator Station

Title of the Paper

Simulator-based Mixed Reality eVTOL Pilot Training: The Instructor Operator Station

Paper Information

• Subject Area: Aviation Pilot Training, Mixed Reality Technology
• Keywords: Mixed Reality, Virtual Reality, Cockpit Interaction, Flight Simulator, Pilot Training, Aviation, Human Performance Factors

Research Background and Issues

• Problem or Challenge: The design of new electric vertical take-off and landing (eVTOL) aircraft requires Simplified Vehicle Operations (SVO). However, traditional simulator training facilities and Instructor Operator Station (IOS) designs fail to meet the complex demands of these aircraft. Additionally, there is a lack of dedicated design standards for eVTOL pilot training.
• Significance: eVTOL aircraft are redefining the aviation industry, requiring less from pilots compared to traditional aircraft, but still necessitating training to ensure safety and operational proficiency.
• Research Motivation and Related Work:
  • Flight Simulator Training Devices (FSTD) provide a low-risk and cost-effective training method, but traditional designs have not fully leveraged Mixed Reality (MR) technology.
  • While MR has shown positive effects in cognitive learning, it has yet to fully replace traditional simulators.
  • There is currently a lack of design guidelines for integrating MR into flight training, particularly regarding the technical requirements for the instructor's role.

Solution

• Proposed Solution: The study explored the feasibility of using MR simulators for eVTOL pilot training instructors and identified key Performance Shaping Factors (PSFs) through user research, offering improvement suggestions for IOS design.
• Innovations:
  • A bottom-up approach to identify factors influencing instructor performance.
  • Systematic analysis of how MR technology can assist instructors in guiding flight training.
• Implementation Steps and Key Technologies:
  • Functional testing of the MR simulator using the Varjo Base software tool.
  • User research involving 7 participants with flight training experience, utilizing the think-aloud method to evaluate tool usability.
  • Identification of PSFs across dimensions such as task difficulty, situational complexity, mental and physical energy.
  • Development of a connection tree model linking instructor performance factors, based on user feedback and existing literature.

Research Outcomes

• Specific Outcomes:
  • Clearly defined key factors affecting instructor performance in MR simulators, including task difficulty, situational complexity, mental capacity, and physical adaptability.
  • Summarized the strengths and weaknesses of existing tools, providing specific recommendations for IOS optimization.
  • Proposed further functional developments, such as stabilized pointer tools, mixed camera views, and customizable AR instructions.
• Advantages Over Existing Solutions:
  • MR offers significant advantages in providing real-time feedback and rich interactivity.
  • The utility of tools within the MR environment was validated through user research.
• Experimental or Evaluation Results:
  • Comprehensive evaluation of tools provided by Varjo Base revealed strong performance in visual realism, eye-tracking, and audio feedback, but identified areas for improvement in pointer stability and multi-angle view support.
  • User feedback indicated that while MR technology showed overall positive effects, tool physical interaction and usability need optimization for broader adoption.
• Limitations and Future Directions:
  • Limitations: Current MR technology cannot fully replace traditional simulators, and there is a lack of effective multi-instructor monitoring technology.
  • Future Directions:
    • Development of more advanced automation and real-time feedback systems.
    • Enhancement of physical and haptic interaction technologies in MR environments.
    • Design of specialized IOS functional modules for single-pilot eVTOL configurations.

Conclusion

This study provides systematic technical recommendations for eVTOL pilot training, successfully integrating mixed reality technology into the training process. By identifying key PSFs and analyzing user feedback, the researchers proposed multiple improvement directions, laying the foundation for the development of efficient MR-based pilot training systems and driving technological innovation in the aviation field.