SwitchSpace: Understanding Context-Aware Peeking Between VR and Desktop Interfaces

Title of the Paper

SwitchSpace: Understanding Context-Aware Peeking Between VR and Desktop Interfaces

Paper Information

• Research Area: Human-Computer Interaction (HCI) - Cross-Reality Operations between VR/Desktop Interfaces
• Keywords: Cross-Reality Interfaces, VR Interaction, Desktop Interaction, Context-Aware Technology, User Experience, Experimental Study, Input Switching, Output Switching, Transitional Interfaces, Hybrid Realism

Research Background and Problem Statement

• Identified Issues or Challenges:

  1. Users experience significant time delays and physical and cognitive inconvenience when switching between virtual reality (VR) and desktop interfaces.
  2. Current methods, such as displaying desktop content within VR, improve some aspects of the switching process but fail to fully address the fluidity of the transition experience.
  3. There is a lack of comprehensive research on user preferences and habits in workflows that span VR and desktop environments.

• Importance of the Problem: As VR becomes increasingly utilized for content creation, the demand for seamless interaction across 2D desktop and 3D VR environments grows. Optimizing these transitions is crucial for enhancing user efficiency and experience.

• Research Motivation and Related Work:

  • Previous studies have primarily focused on independent interactions within 2D and 3D interfaces, with limited exploration of context switching between the two.
  • Literature from domestic and international sources suggests that multimodal interaction research, which integrates 2D and 3D environments, has the potential to deepen user immersion and reduce transition difficulties. However, the design space for transitional interfaces remains underexplored.

Solution

• Proposed Method or Solution:

  1. Introduced a cross-reality interaction design space called "SwitchSpace," which enables users to quickly "peek" between VR and desktop interfaces without fully switching input and output devices.
  2. SwitchSpace is designed based on a state machine that triggers appropriate "peeking" techniques depending on the user's current input device (mouse vs. VR controller) and viewing device (desktop monitor vs. VR headset).
  3. Implemented various "peeking" techniques, such as:
     • Simulated headset view of the desktop within VR.
     • Wrist-mounted quick desktop viewport in VR.

• Innovative Contributions:

  1. Developed the concept of "peeking" for transient transitions, distinct from full device switching.
  2. Decoupled input and viewing device switching processes within the design space model to enhance flexibility.
  3. Built a fully functional interactive prototype for evaluation and conducted comparative studies with baseline methods lacking peeking functionality.

• Implementation Steps:

  1. Conducted formative user research with 24 frequent VR users to gather feedback on cross-reality interaction habits and challenges.
  2. Developed the SwitchSpace system and implemented multiple peeking techniques based on the research findings.
  3. Designed experimental tasks (e.g., solving mathematical problems requiring data retrieval from another interface) to collect user behavior data under different conditions.

Research Findings

• Specific Results:

  1. Summarized real-world cross-interface workflow characteristics and preferences from preliminary research with VR users and creators.
  2. Developed and validated a set of VR-to-desktop "peeking" techniques that significantly reduce discomfort associated with existing methods.
  3. Experimental results demonstrated:
     • Task completion time decreased by an average of 38% when using peeking techniques (from 23.8 seconds to 14.8 seconds).
     • Peeking techniques significantly reduced precision differences between mouse and VR controller inputs during drag-and-drop tasks.
     • NASA-TLX workload assessments showed reductions in perceived cognitive, physical, and time-related stress.

• Comparison with Existing Solutions:

  1. Compared to full device-switching methods, peeking techniques minimized hardware transition inconveniences.
  2. Users preferred low-overhead methods (e.g., body-bound or world-fixed interface presentation techniques) that reduce hardware interaction or movement.

• Experimental or Evaluation Results:

  • Task Time: Peeking techniques improved task completion times for transitions between VR and desktop interfaces in both directions.
  • Precision: Input precision differences between controllers and mice disappeared under peeking conditions.
  • Workload: Users experienced significant reductions in physical and cognitive stress.
  • User Feedback: 92% of participants preferred peeking techniques over full device switching.

• Limitations and Future Directions:

  1. Limitations:
     • Experimental scenarios were relatively simple and did not cover more complex 3D modeling tasks.
     • Hardware dependency may limit compatibility with non-high-end VR systems.
  2. Future Directions:
     • Implementation and evaluation of more complex dynamic tasks.
     • Support for multi-user cross-reality collaboration scenarios.
     • Introduction of higher-fidelity "perspective views" to enhance peeking effectiveness.

We believe that SwitchSpace provides users with a fast and non-intrusive transitional experience, improving the efficiency of cross-reality interactions while offering a practical framework and design principles for future transitional interface designs.