PhoneInVR: An Evaluation of Spatial Anchoring and Interaction Techniques for Smartphone Usage in Virtual Reality

Document Title

PhoneInVR: An Evaluation of Spatial Anchoring and Interaction Techniques for Smartphone Usage in Virtual Reality

Document Information

• Domain: Human-Computer Interaction and Virtual Reality Technology
• Keywords: Virtual Reality, Smartphone, Touch Input, Human-Computer Interface, User Study

Research Background and Problem

• Identified Issues or Challenges:

  1. When using virtual reality (VR) head-mounted devices, users often lose convenient interaction capabilities with smartphones and their applications.
  2. Existing solutions, such as video passthrough technology or customized VR smartphone applications, suffer from low resolution, latency, or steep learning curves.

• Significance: Smartphones are essential tools for modern individuals to access information and conduct daily communication. Exploring the feasibility of accessing smartphones in immersive VR environments can significantly enhance user experience and reduce barriers in switching between devices.

• Research Motivation and Related Work:

  1. Previous studies have attempted to use smartphones as augmented VR controllers or design specialized interfaces, but few have focused on direct daily smartphone interactions (e.g., swiping, scrolling) within VR environments.
  2. There is a lack of comprehensive comparisons in the research community regarding how different spatial anchoring methods and interaction techniques affect typical smartphone tasks.

Solution

• Proposed Methods or Solutions: The authors propose three spatial anchoring methods and two interaction techniques, designing an experiment to evaluate their effectiveness in using smartphones in VR:

  1. Spatial Anchoring:
     • Phone-locked: The virtual phone is fully aligned with the physical smartphone.
     • Hand-locked: The virtual phone is fixed to the user's virtual hand, without a physical smartphone.
     • World-locked: The virtual phone is presented in a static spatial position.
  2. Interaction Techniques:
     • Touch: Mimics traditional direct touch input on smartphones.
     • Pinch: Uses gesture-based non-contact input, suitable for immersive environments.

• Innovations:

  • Proposes a diversified comparative framework based on real smartphones, virtual hands, and fixed spatial anchoring.
  • Considers the impact of physical touch perception and visual feedback on user experience.
  • Conducts in-depth performance testing using common smartphone operations (target selection, swiping, scrolling).

• Implementation Steps and Key Technologies:

  1. Develop a virtual environment and interface, synchronizing real smartphone touch events to ensure experimental accuracy.
  2. Define experimental tasks to evaluate user performance and precision through target selection, swiping, and scrolling operations.
  3. Conduct user testing with Oculus Quest 2 and collect user preferences through questionnaires.

Research Results

• Specific Findings:

  1. Experiments show that under touch interaction, holding a physical smartphone (Phone-locked) significantly improves task completion speed and accuracy; in the absence of a physical smartphone, pinch interaction performs better.
  2. Spatial anchoring with the phone bound to the virtual hand (Hand-locked) received lower user preference due to the lack of physical support and performed worse than other anchoring methods.

• Advantages Over Existing Solutions:

  • Compared to customized VR interfaces or traditional video passthrough technology, the proposed solution directly utilizes existing smartphone tasks and operation modes, reducing the learning curve.
  • The combination of different anchoring methods and interaction techniques covers multiple user scenarios, offering greater flexibility.

• Experimental and Evaluation Results:

  1. Target Selection: Phone-locked combined with Touch technology achieved the fastest speed and lowest error rate.
  2. Swiping: Pinch performed significantly better than Touch under Hand-locked and World-locked conditions.
  3. Scrolling: The tactile feedback of the physical smartphone helped reduce scrolling errors.
  4. User Preferences: Users preferred Phone-locked combined with Touch technology, followed by World-locked combined with Pinch.

• Limitations and Future Directions:

  1. Limitations:
     • The experiment restricted the smartphone's position to reduce tracking errors, limiting the evaluation of dynamic usage scenarios.
     • Did not test the impact of enlarging the virtual smartphone size on content readability and interaction performance.
  2. Future Directions:
     • Extend research to dynamic smartphone tracking performance in real-world usage scenarios.
     • Explore performance comparisons between VR-optimized smartphone application layouts and traditional interfaces.
     • Investigate how hybrid interfaces between VR and AR devices affect user experience and cross-device collaboration capabilities.

Conclusion

This study proposes and validates a solution for using smartphones in virtual reality environments. Through experimental combinations of spatial anchoring methods and interaction techniques, it provides a theoretical and practical framework that lays the foundation for future research.