Re-Evaluating VR User Awareness Needs During Bystander Interactions

Title of the Paper

Reevaluating VR Users' Awareness Needs in Bystander Interactions

Paper Information

• Research Domain: Human-Computer Interaction and Virtual Reality Technology
• Keywords: Virtual Reality, Mixed Reality, Augmented Reality, Bystander-VR User Interaction, Interruption, Awareness, Situational Awareness

Research Background and Problem Statement

• Identified Problems:

  1. Due to the enclosed nature of head-mounted displays, VR users struggle to perceive the presence or actions of bystanders (non-VR users), leading to safety risks (e.g., collisions), difficulties in handling interruptions, and privacy concerns.
  2. Existing VR bystander awareness systems provide methods to enhance user awareness, but it remains unclear when and why specific methods should be chosen in different social contexts.

• Research Importance: As VR applications become increasingly prevalent (e.g., in home and social environments), interactions between users and bystanders are becoming more frequent. Effective VR posture sensing and interaction mechanisms are critical for user experience and safety.

• Research Motivation: By reviewing previous literature and identifying shortcomings in existing solutions, this study aims to explore bystander awareness needs across various contexts, driving the design of more intelligent and adaptive systems.

Proposed Solutions

• Methods and Design:

  1. Experimental Design: Two-tiered experimental evaluation: Baseline Usability and Awareness Needs Assessment.

     • The first phase evaluates the usability of seven bystander awareness systems and their impact on VR users' "sense of presence."
     • The second phase introduces 14 real-world interaction scenarios, employing a "think-aloud protocol" to analyze user preferences and needs in specific interaction contexts.

  2. Seven Awareness Systems: These include text notifications, realistic virtual avatars, three types of passthrough views (e.g., full passthrough pause mode), dynamic audio reduction, and complete audio removal. Each method features clear technical implementations and specific mixed reality information delivery mechanisms.

• Innovations:

  1. A comprehensive integration of multiple awareness systems, providing a unified comparison of their performance in specific interaction scenarios.
  2. The first identification and proposal of key "awareness transition moments" for VR users during bystander interactions (e.g., when a bystander enters the room, approaches the user's operational area, or engages in verbal interaction).
  3. Clarification of four primary user demand types (e.g., gradually adaptive users vs. immersion-prioritizing users).

Research Outcomes

• Key Findings:

  1. Proposed and validated a dynamic awareness needs model for VR users in various bystander interaction scenarios.
  2. Identified critical interaction points most relevant to users, including (1) a bystander entering the room, (2) approaching the user's operational area, and (3) engaging in verbal interaction with the user.
  3. Determined that the type of bystander (e.g., pets, groups of bystanders, or unfamiliar strangers) significantly influences users' awareness needs.

• Comparison with Existing Solutions: Many current studies focus solely on evaluating the usability or intrusiveness of systems, neglecting the dynamic and context-specific needs of users during real-world usage. This paper addresses this gap.

• Experimental or Evaluation Results:

  1. Most users preferred visual cues (e.g., realistic avatars), but in deeper interaction scenarios, users favored dynamic adjustments, such as opting to pause all virtual tasks (Full Passthrough + Pause).
  2. Bystander behavior within internal spaces was more noticeable to users than external bystander behavior, as it more frequently triggered safety or privacy concerns.
  3. Bystander actions involving privacy-sensitive behaviors (e.g., recording the user) significantly increased users' demand for awareness information.

• Limitations and Future Directions:

  1. Limitations: The experiments were conducted in controlled environments and focused solely on game-based interaction scenarios, which may not fully apply to work or production settings. The VR hardware used in the experiments (black-and-white passthrough view) did not include features of modern devices (e.g., color passthrough).
  2. Future Directions:
     • Expand research to include multi-context and long-term studies (e.g., bystander interactions in indoor production environments or mixed reality collaboration scenarios).
     • Promote the design and validation of socially intelligent awareness systems using advanced sensing technologies (e.g., social signal processing and situational awareness).
     • Explore dynamic interaction challenges in collaborative environments through interdisciplinary approaches (e.g., transitions from bystander to collaborator).