You spin me right 'round, baby, right 'round: Examining the Impact of Multi-Sensory Self-Motion Cues on Motion Sickness During a VR Reading Task

Title of the Paper

You spin me right round, baby, right round: Examining the Impact of Multi-Sensory Self-Motion Cues on Motion Sickness During a VR Reading Task

Paper Information

• Research Domain: Human-Computer Interaction (HCI), Virtual Reality (VR), Multi-sensory and Motion Sickness Studies
• Keywords: Motion sickness, virtual reality, rotation, autonomous driving, multi-sensory feedback, visual cues, auditory cues, self-motion perception, presence, productivity

Research Background and Issues

• Problem or Challenge:

  • Participants engaging in productivity tasks such as reading in virtual reality (VR) may experience motion sickness induced by rotational motion, posing a significant obstacle to VR applications in autonomous vehicles.
  • Sensory conflict (discrepancy between visual and vestibular inputs) is a key factor causing motion sickness, especially when mismatched sensory inputs occur during vehicle movement, exacerbating symptoms.
  • While VR offers immersive and productivity-enhancing potential, it may intensify sensory conflicts, leading to more severe motion sickness.

• Significance:

  • With the proliferation of autonomous vehicles, people are expected to utilize in-car time for non-driving activities such as work and entertainment.
  • Effective motion sickness mitigation strategies are necessary to ensure comfort and efficiency in these environments.

• Research Motivation and Related Work:

  • Existing studies have explored the role of visual and visual+auditory sensory cues, suggesting they may help alleviate motion sickness, though conclusions are inconsistent and some findings remain unverified.
  • This study aims to evaluate whether visual, auditory, and combined multi-sensory cues can effectively mitigate motion sickness, as well as their impact on task performance, cognitive load, and presence during VR use.

Solution

• Methods and Solution:

  • Utilize an actuated rotating chair to simulate physical rotational scenarios combined with a VR reading task to test the effectiveness of visual and auditory self-motion cues in alleviating motion sickness.
  • Design multi-sensory cues with semantic information, such as visual scenes paired with corresponding sounds (e.g., bird chirping, bell ringing, construction noise).
  • Examine cue configurations under various conditions, including visual-only, auditory-only, visual+auditory, and baseline conditions without cues.

• Innovations:

  • First-time integration of auditory motion cues in physical rotational scenarios to assess their impact on motion sickness.
  • Systematic evaluation of how multi-sensory cues influence presence, reading task performance, and motion sickness mitigation in VR experiences.
  • Provide insights into designing effective multi-sensory cues, advancing VR applications in autonomous vehicles.

• Implementation Steps and Techniques:

  • Study design: Four experimental conditions (visual-only, auditory-only, visual+auditory, no matching cues), employing multiple trial rounds to eliminate cumulative effects between conditions.
  • Configure Unity-based virtual scenes and soundscapes, utilizing auditory spatialization techniques and VR controllers for interaction.
  • Simulate rotational motion using an actuated rotating chair, reflecting physical movement characteristics typical of daily commutes.

Research Findings

• Specific Findings:

  1. Visual cues (whether combined with auditory cues or not) effectively alleviated participants' motion sickness symptoms.
  2. Auditory cues alone had relatively weaker mitigation effects, showing partial positive outcomes only when combined with visual cues.
  3. The combination of auditory and visual cues did not significantly impact task performance or presence but reduced participants' physiological and psychological burden.

• Comparison with Existing Solutions:

  • Compared to existing studies, this research is the first to validate the role of auditory cues in physical rotational scenarios, enriching the design and optimization of sensory cues.
  • Highlights the importance of semantic context and multi-sensory integration, confirming their effectiveness in mitigating sensory conflicts.

• Experimental or Evaluation Results:

  • Motion Sickness: Overall, visual cues were the most effective in reducing motion sickness, while auditory cues alone showed no significant effect.
  • Task Performance: Reading comprehension scores remained unchanged across all conditions, but higher motion sickness symptoms were associated with significantly slower reading speeds.
  • Presence: Presence was negatively correlated with motion sickness symptoms but was not sensitive to changes in multi-sensory cues.

• Limitations and Future Directions:

  • Limitations:

    1. The study only examined rotational motion (yaw rotation) and did not address linear acceleration or other complex movements.
    2. The reading task was limited to short durations (15 minutes), which may not fully reflect real-world long-duration productivity tasks in vehicles.
    3. The sustained effects of multi-sensory cues require further validation.

  • Future Directions:

    1. Explore the effects of more complex motion patterns and longer durations on cue effectiveness.
    2. Test the potential of tactile or real-time predictive sensory cues.
    3. Optimize multi-sensory cue designs for different productivity or entertainment tasks.
    4. Investigate novel semantic auditory or visual cue designs to enhance overall user experience.

Through this study, the authors provide new insights into VR application design in autonomous driving environments, laying a critical foundation for technical practices aimed at alleviating motion sickness.