Embodying Physics-Aware Avatars in Virtual Reality

Title of the Paper

Embodying Physics-Aware Avatars in Virtual Reality

Paper Information

• Field of Study: Virtual reality avatars and enhanced physical perception
• Keywords: Physics-aware avatars, virtual reality, embodiment, sense of body ownership, multisensory interaction

Research Background and Problem

• Problem or Challenge:

  • In current virtual reality systems, user-controlled avatars typically rely on a one-to-one mapping with user movements, which helps maintain visual-proprioceptive consistency.
  • However, this one-to-one mapping exposes issues during interactions with virtual environments, such as when the virtual body passes through objects or fails to react to collisions, leading to a lack of physical realism.
  • This lack of physical realism may reduce the user's sense of embodiment with the avatar.

• Significance:

  • Enhancing the physical realism of virtual body interactions (e.g., contact between the user and the environment) can improve the user's sense of embodiment and enhance immersion and presence in virtual reality.

• Research Motivation and Related Work:

  • Existing studies primarily focus on the visual and motor perception of avatars, with limited exploration of physical interactions between avatars and virtual environments.
  • Physical simulations (e.g., cloth and fluid simulation) have been widely applied in virtual reality, but their application to avatars remains limited.
  • Investigating the impact of enhanced physical perception on the sense of embodiment can further improve the VR user experience.

Solution

• Method and Solution:

  • A physics-aware avatar is proposed, capable of improving user avatar movement behavior through physics correction.
  • To study the effects of this enhancement, an experiment was designed where users completed two types of interaction tasks in a VR environment: active tasks (users actively move and interact with obstacles) and passive tasks (obstacles strike the user's avatar).

• Innovations:

  • The study systematically evaluates the impact of physics-aware avatars on the user's sense of embodiment and experience for the first time.
  • It explores user sensitivity to the degree of physics correction applied to avatars (e.g., the potential negative effects of overly strong or weak corrections on the sense of embodiment).

• Implementation Steps and Key Technologies:

  1. Experimental Design: A within-subject experiment where each participant experiences both physics-corrected and non-corrected avatar conditions.
  2. Technical Implementation: Physics-based avatar control was built using the Unity engine and its physics simulation plugins (PuppetMaster and Final IK).
  3. Data Collection: Embodiment data was collected via questionnaires, alongside performance metrics during the tasks (e.g., preferred correction levels and avatar movement responses).
  4. Analysis Methods: Combined quantitative analysis (e.g., Wilcoxon test) with qualitative user feedback.

Research Results

• Specific Findings:

  1. Functional Improvements of Enhanced Avatars:
     • In active interactions, physics-aware avatars significantly increased overall embodiment (p=0.017).
     • In passive interactions, all participants preferred avatars with physics correction, believing it enhanced the realism of the virtual experience.
  2. Correction Threshold Discovery:
     • User preferences for physics correction were concentrated within a response offset range of 32 to 36 cm.
     • Excessive corrections (e.g., full-body collapse) significantly reduced the user's sense of embodiment.

• Comparison with Existing Solutions:

  • Physics-aware avatars overcome the limitations of traditional one-to-one mapping, enhancing user interaction perception with virtual environments.
  • The study shows that users are willing to accept slight mismatches in visual-proprioceptive consistency for more natural physical responses.

• Experimental Evaluation Results:

  • Questionnaire results indicate that physics-aware avatars outperform non-corrected avatars in terms of visual appearance, responsiveness, and multisensory experience.
  • However, issues remain, such as some users feeling a reduction in avatar autonomy in certain situations.

• Limitations and Future Directions:

  • The experiment primarily focused on upper-body interactions and did not include legs or other body parts; future research could extend to full-body interactions.
  • The study relies on visual feedback from head-mounted displays; as hardware improves (e.g., wider fields of view), future research could examine whether other body parts require similar enhancements.
  • Further exploration of personalized avatar customization and its impact on user experience is recommended.
  • Future studies could investigate more objective measures of embodiment, such as physiological or electrophysiological indicators.