SYNC-VR: Synchronizing Your Senses to Conquer Motion Sickness for Enriching In-Vehicle Virtual Reality

Title of the Paper

SYNC-VR: Synchronizing Your Senses to Conquer Motion Sickness for Enriching In-Vehicle Virtual Reality

Paper Information

• Research Area: Applications of Human-Computer Interaction and Virtual Reality in Autonomous Vehicles
• Keywords: Autonomous Vehicles, Virtual Reality, Motion Sickness, Presence, Visual Cues, Motion Feedback, Sensory Synchronization, Haptic Feedback

Research Background and Problem

• Research Questions and Challenges:
  1. Although Virtual Reality (VR) technology has potential applications in autonomous vehicles, the inconsistency between visual and physical sensory inputs caused by vehicle movement easily triggers motion sickness (MS).
  2. Many current studies focus on using visual cues to reduce MS but overlook how multi-sensory inputs can work together to enhance passenger presence and reduce MS.
• Significance: The widespread adoption of autonomous vehicles provides passengers with opportunities for non-driving activities (e.g., entertainment and work), making MS alleviation a critical issue for improving passenger experience. This is also part of advancing mobile VR as the next-generation mobility solution.
• Motivation: While several studies have explored methods to reduce MS by matching visual cues with vehicle motion, their effectiveness remains limited. Developing an effective cross-sensory synchronization framework is an urgent problem to address.
• Related Work:
  1. Techniques using visual matching to reduce MS have shown certain limitations;
  2. The potential of introducing haptic feedback and interaction to enhance presence has been partially demonstrated in prior studies;
  3. Autonomous vehicles enable real-time data collection and predictive analysis, providing opportunities to integrate VR experiences with vehicle dynamics.

Solution

• Methods and Framework:
  1. SYNC-VR Framework:
     • Synchronizes passengers' visual, haptic, auditory, and proprioceptive feedback to align VR content with actual vehicle motion.
     • Integrates multi-sensory inputs, including electrical muscle stimulation (EMS) for haptic feedback, and designs interactive scenarios to provide proprioceptive feedback.
  2. Experimental Design:
     • Four experimental conditions were set up, progressively increasing the degree of sensory synchronization (including visual cues, interactive scenarios, proprioceptive feedback, and EMS-based haptic feedback).
     • Data was collected along real driving routes to evaluate MS, presence, and workload.
• Innovations:
  1. Introducing EMS devices to simulate haptic feedback, enhancing passenger immersion;
  2. Designing adaptive VR scenarios that synchronize in real-time with vehicle dynamics, strengthening sensory connection;
  3. Systematically comparing the effects of multi-sensory synchronization to validate MS control during VR use.

Research Findings

• Specific Results:
  1. The SYNC-VR framework significantly improved passenger presence when visual and haptic synchronization was implemented, receiving the highest participant ratings.
  2. The addition of haptic and proprioceptive feedback reduced MS symptoms and significantly lowered psychological and physiological burdens.
  3. By combining real-time interaction and synchronized scenario design, the VR experience became more immersive and comfortable.
• Experimental and Evaluation Results:
  1. Under Condition 4 (SYNC-VR framework including visual cues, interactive scenarios, and haptic feedback), presence was significantly higher than in other conditions.
  2. MS did not significantly increase under Condition 4, and some participants experienced alleviated MS symptoms.
  3. Based on NASA-TLX evaluations, Condition 4 had the lowest workload, and participants reported the highest satisfaction.
  4. Heart rate data indicated that Condition 4 reduced physiological stress caused by inconsistent sensory inputs.
• Advantages:
  1. Multi-sensory integration outperformed single visual cues significantly;
  2. Enhanced passengers' predictability of vehicle motion, providing a sense of safety and comfort.
• Limitations and Future Directions:
  1. The current experimental route was relatively short, unable to simulate diverse long-distance driving scenarios.
  2. Further testing is required to evaluate the adaptability of the SYNC-VR framework for different VR application scenarios (e.g., work meetings, entertainment).
  3. The independent contribution of specific haptic signal parameters to MS alleviation was not fully explored.

Conclusion

The SYNC-VR framework effectively enhances passenger comfort and immersion in VR use within vehicles by synchronizing visual, haptic, and proprioceptive feedback. It validates the optimization of multi-sensory input as a theoretical and practical foundation for designing embedded VR systems in future autonomous vehicles. Future work should expand to long-distance driving conditions and explore the framework's adaptability across multiple application domains, ultimately achieving the goal of providing passengers in autonomous vehicles with safe, efficient, and immersive VR experiences.