Poros: Configurable Proxies for Distant Interactions in VR

Document Title

Poros: Configurable Proxies for Distant Interactions in VR

Document Information

• Subject Area: Interaction design and spatial operations in virtual reality
• Keywords: virtual reality, spatial proxies, world-in-miniature, 3D user interface, distant interaction, interaction techniques, configurable proxies, gesture interaction

Research Background and Problem

• Identified Problems or Challenges: While virtual reality provides high immersion, the interaction range is typically limited to the space reachable by the user. For instance, users in a virtual room must physically move or use teleportation techniques to interact with distant objects. Existing solutions for distant interaction (e.g., arm extension or spatial portals) suffer from reduced precision and distorted views.
• Significance: Efficient and natural interaction with distant objects is critical for enhancing the practicality of virtual reality applications, especially in dynamic and complex scenarios or tasks requiring rapid access to multiple points.
• Motivation and Related Work: Building on existing "world-in-miniature" and "portal" techniques, this research explores user-configurable spatial proxies to address efficiency and naturalness in distant interactions. Related work, such as "spatial warping techniques" and "distant target selection techniques," has made progress but still imposes constraints on users' flexible manipulation of space.

Solution

• Proposed Solution: The Poros system allows users to mark distant spaces and mirror these spaces as "proxy spaces" for close-range interaction. Users can operate within the proxies without physically moving to the distant locations.
• Innovations:
  • Achieves spatial reconstruction through marking and proxies without altering the user's body or view structure.
  • Proxy spaces are not only interactive but also integrated into the scene, supporting operations like movement, rotation, scaling, merging, and splitting.
  • Enables advanced interactions such as cross-space alignment, action replication, and object-focused search.
• Implementation Steps and Key Technologies:
  1. Space Marking and Proxy Creation: Users mark distant spaces via gestures, generating an interactive proxy space in real-time.
  2. Interaction Methods: Users directly manipulate objects within the proxy space and can transfer objects from the proxy to the main scene.
  3. Proxy Operations: Users can scale, move, rotate, and dynamically anchor the proxy space.
  4. Advanced Operations: Features such as merging, cross-space alignment, and content highlighting support the execution of complex tasks.
  5. Technical Design: The system is developed using the Unity engine, incorporating Leap Motion for gesture tracking and custom rendering techniques to ensure consistency between the proxy space and the main environment.

Research Outcomes

• Specific Outcomes:
  • Developed a complete system enabling users to flexibly create and manipulate distant spatial proxies.
  • Demonstrated the application of Poros in various scenarios, including handling occluded objects, cross-scale interactions, multi-perspective visualization, and dynamic object monitoring.
  • Validated the system's ability to reduce interaction distances and enhance interaction naturalness through proxies.
• Advantages:
  • Compared to traditional distant interaction techniques such as teleportation or arm extension, Poros effectively addresses issues of view distortion and interaction precision while aligning more closely with natural user behavior.
  • Offers greater flexibility and multifunctionality than "world-in-miniature" and "portal" systems.
• Experimental Results:
  • Expert evaluations confirmed the clarity of the system's concept and the relevance of its application scenarios.
  • Experts noted that Poros is suitable for detailed tasks such as monitoring, sorting, and spatial configuration, while recommending further improvements in interaction consistency.
• Limitations and Future Directions:
  • Limitations: Users may face a learning curve when creating and adjusting marked spaces; the system does not support body scaling or user spatial movement.
  • Future Directions: Explore more complex proxy space shapes, incorporate automated operations (e.g., intelligent object alignment), develop content replication features, and enhance user feedback mechanisms (e.g., haptic feedback). Additionally, investigate the potential of this technology in collaborative scenarios or broader applications.

Conclusion

The Poros system presents an innovative spatial interaction technique that enables users to efficiently manipulate distant objects through configurable proxies. This technology surpasses traditional virtual reality interaction methods and demonstrates how virtual spaces can become more intelligent and user-adaptive. Its open-source nature provides a foundation for further research and development in both academia and industry.