The Ergonomic Benefits of Passive Haptics and Perceptual Manipulation for Extended Reality Interactions in Constrained Passenger Spaces

Title of the Paper

The Benefits of Passive Haptics and Perceptual Manipulation for Extended Reality Interactions in Constrained Passenger Spaces

Paper Information

• Domain: Human-Computer Interaction (HCI), Extended Reality (XR), and Virtual Reality (VR)
• Keywords: Virtual Reality, Constrained Spaces, Passive Haptics, 3D User Interfaces, Airplanes, Extended Reality, Selection

Research Background and Problem

• Identified Problem or Challenge: Interacting with extended reality devices in constrained spaces, such as airplanes, poses ergonomic challenges. For instance, the physical surfaces users need to touch may be inconveniently located, leading to discomfort and reduced interaction performance, with long-term usage being further limited.
• Importance of the Problem: As global air travel resumes, these constrained spaces represent a significant application scenario for extended reality technologies. XR can provide users with an immersive escape from the cramped travel environment, offering a richer virtual experience.
• Research Motivation and Related Work: While passive haptics and visual manipulation techniques have been explored in the XR/VR domain, there is limited research on optimizing interaction performance and user experience in extremely constrained spaces. The airplane seat environment, in particular, remains an underexplored yet high-potential application scenario.

Proposed Solution

• Proposed Solution: The authors propose combining passive haptic surfaces with visual manipulation techniques by remapping the position and orientation of physical surfaces to optimize user experience and comfort.
• Innovative Aspects:
  • The use of moderate translation and rotation manipulation techniques to visually reposition physical surfaces to more comfortable perceived locations.
  • Development of passive haptic surface usage techniques in constrained spaces, with quantitative and qualitative comparisons to mid-air interaction techniques.
• Implementation Steps and Key Technologies:
  • Using the tray table and seatback of airplane seats as passive haptic surfaces to ensure ecological validity in the experiments.
  • Leveraging hand-tracking technology from Oculus Quest 2 for interface operations, alongside accurately calibrated physical surfaces for virtual remapping.
  • Designing two studies: the first comparing task performance between passive haptics and mid-air interaction; the second exploring the remapping of object positions and orientations to enhance ergonomic comfort.

Research Outcomes

• Specific Findings:
  • Passive haptics outperformed mid-air interaction in several aspects, including lower workload, faster selection and dragging times, and reduced arm fatigue.
  • Moderate remapping (45° and 60°) achieved an effective balance between performance and comfort, significantly reducing neck fatigue.
• Advantages:
  • Compared to mid-air interaction alone, passive haptics significantly improved user experience and interaction performance.
  • Moderate remapping strategies optimized ergonomics, enabling prolonged XR usage in constrained spaces.
• Experimental or Evaluation Results:
  • Participant feedback indicated that remapping conditions of 45° and 60° were preferable to more extreme remapping (e.g., 90°).
  • Data supported the effectiveness of passive haptic surfaces, particularly in horizontal configurations, for interaction scenarios.
• Limitations and Future Directions:
  • Limitations include the laboratory environment not fully simulating real airplane conditions, such as the effects of airplane motion on interaction.
  • Future work suggests investigating specific constraints of different transportation modes and further optimizing surface remapping models for diverse scenarios.
  • Validation of findings in real-world usage contexts (e.g., airplane or car backseats) and exploration of factors related to social acceptability.

Design Guidelines

The authors propose three design principles for XR interaction in constrained spaces:

1. Leverage Nearby Physical Surfaces for Passive Haptic Interaction: Appropriately use tray tables and seatbacks as interaction surfaces to enhance precision and comfort.
2. Adopt Moderate Visual Remapping Techniques: Optimize user experience and long-term comfort by adjusting surface rotation and position by 45° or 60°.
3. Consider the Distance Between Virtual and Real Hands: Avoid confusion caused by virtual hand positions being too close to real hand positions in visual effects.

These principles provide practical guidelines for future XR interaction design and offer clear directions for adapting XR applications to constrained spaces.