From Disruption to Immersion: Reimagining Vehicle Motion as Environmental Feedback through Force Mappings in In-Car VR

Paper Title

From Disruption to Immersion: Reimagining Vehicle Motion as Environmental Feedback through Force Mappings in In-Car VR

Publication Info

• Topic area: Leveraging vehicle motion as a resource for immersive feedback in in-car VR systems.
• Keywords: In-car VR, force mappings, motion feedback, virtual reality, perceptual coherence, motion sickness, immersive design, environmental feedback, user experience, vehicle dynamics.

Background and Problem

• Problem / challenge: Existing in-car VR systems primarily focus on synchronizing virtual motion with real-world vehicle motion to reduce motion sickness and improve immersion. However, this approach limits the scope of VR content to passive or vehicle-aligned experiences, neglecting the potential of vehicle-induced forces as a creative resource for environmental feedback.
• Significance: Reinterpreting vehicle motion as environmental feedback could expand the design space for in-car VR, enabling richer, more varied, and contextually adaptive experiences while maintaining comfort and coherence.
• Motivation and related work: Prior research has explored direct motion synchronization and multimodal feedback to address sensory mismatches in in-car VR. Some studies have begun to reinterpret real-world sensations as virtual effects, but these efforts are limited in scope and lack a systematic framework for leveraging vehicle forces as immersive feedback.

Solution

• Proposed approach: The concept of force mappings, a design framework that translates vehicle-induced forces (e.g., acceleration, turning, rough terrain) into multisensory environmental feedback within VR.
• Novelty:
  1. Introduction of a systematic design framework for force mappings, categorizing vehicle-induced forces and mapping strategies.
  2. Implementation of four distinct force mappings (Ground-based, Wind-based, Current-based, Object-based) in a real-time in-car VR system.
  3. Empirical evaluation of perceptual coherence and user experience through two user studies, providing actionable insights for future in-car VR design.
  4. Demonstration of how non-direct mappings enable creative reinterpretations of vehicle motion, expanding the scope of VR content.
• Procedure and key techniques:
  • Development of a sensor-based platform using IMU and GPS modules to detect vehicle motion and translate it into virtual force mappings.
  • Implementation of four mapping strategies:
    • Ground-based: Tilting the virtual ground to simulate inertial forces.
    • Wind-based: Representing forces as directional wind.
    • Current-based: Visualizing forces as underwater currents.
    • Object-based: Using moving objects to metaphorically represent forces.
  • Conducting two user studies:
    • Study 1 (E1): Evaluated perceptual coherence and derived optimal gain values for force mappings.
    • Study 2 (E2): Assessed user experience, motion sickness, presence, and enjoyment in ecologically valid driving scenarios.

Results

• Concrete findings:
  • Participants consistently required amplified visual feedback (gain > 1.0) to achieve perceptual coherence with physical forces.
  • Ground-based mappings achieved the highest coherence ratings and were most preferred overall.
  • Non-direct mappings (Wind-based, Current-based, Object-based) were effective in creating diverse and engaging experiences, though coherence varied by context.
  • Motion sickness was significantly reduced in all mapping conditions compared to a static baseline.
• Advantage over baselines:
  • All force mapping conditions outperformed the static baseline in reducing motion sickness, increasing presence, and enhancing enjoyment.
  • The empirically tuned mappings (using calibrated gains) provided better user experience compared to one-to-one theoretical mappings.
• Experiments / evaluation:
  • Experiment 1 (E1):
    • Participants adjusted gain values for each mapping-event combination (16 total) to match perceived physical forces.
    • Results showed event-specific asymmetries (e.g., higher gains for acceleration, lower for turns).
  • Experiment 2 (E2):
    • Compared static, direct, theoretical, and empirical mapping conditions in narrative-rich VR scenarios.
    • Empirical mappings and direct mappings were most preferred, with significant improvements in presence and enjoyment over static conditions.
• Limitations and future work:
  • Current system is reactive and cannot anticipate abrupt events like speed bumps; predictive sensing could address this.
  • Limited exploration of hybrid or mixed mapping strategies.
  • Future work could extend mappings to incorporate directional gains, dynamic user locomotion, and multimodal feedback (e.g., haptics, audio).

Summary

This paper introduces the concept of force mappings, a novel framework for translating vehicle-induced forces into immersive environmental feedback in in-car VR. Through two user studies, the authors demonstrate that force mappings improve perceptual coherence, reduce motion sickness, and enhance user experience. The findings highlight the potential of non-direct mappings to expand the design space for in-car VR, enabling diverse applications from productivity to entertainment. By treating vehicle motion as a creative resource, this work provides actionable guidelines for designing adaptive and engaging in-car VR systems.