In-Depth Mouse: Integrating Desktop Mouse into Virtual Reality

Title of the Paper

In-Depth Mouse: Integrating Desktop Mouse into Virtual Reality

Paper Information

• Research Area: Virtual Reality (VR), User Interface Design, Human-Computer Interaction
• Keywords: Virtual Reality, 3D Pointer, Target Selection, Desktop Workspace, Depth-Adaptive Cursor

Research Background and Problem

• Identified Issues:
  Virtual Reality (VR) holds immense potential, but current controllers or gesture-based interactions fail to meet the demands of tasks requiring high precision and prolonged comfort. Specifically, when supporting 3D target selection, traditional mouse usage encounters three primary challenges:

  • Diplopia (Binocular Disparity): Users need to adjust focus to select targets at different depths, which may lead to inconsistent binocular vision, causing discomfort and reduced operational performance.
  • Perspective Issue: In 3D scenes, mouse movement must adapt to the user's viewpoint, which is not reflected in existing mouse control methods.
  • Sensitivity Issue: The control-display gain (CD Gain) of mouse sensitivity can lead to selection errors or frequent mouse resets when dealing with VR's large display areas.

• Significance:
  Developing more precise and comfortable input devices for VR environments directly impacts user efficiency, especially in work scenarios that require frequent switching between 2D and 3D content, such as 3D modeling and data analysis. Addressing these issues will facilitate the adoption of virtual workspaces.

• Research Motivation and Related Work:
  The research is motivated by the need to combine existing mouse pointer technologies (e.g., Perspective Cursor) with the specific demands of VR (e.g., depth perception) to propose an improved method for optimizing mouse interaction in VR. The paper also explores related research on AR and VR work environments, highlighting the potential of traditional input devices to enhance precision and reduce fatigue.

Proposed Solution

• Proposed Solution:
  The authors propose a method called Depth-Adaptive Cursor (DAC), a 3D pointer technology based on a 2D mouse that achieves continuous cursor depth interpolation through depth adaptation. This method dynamically adjusts the cursor based on its position, viewpoint, and the depth of selectable objects, addressing the three key issues. Additionally, a theoretical model is proposed to calculate the usable range of mouse CD Gain in VR environments.

• Innovations:

  1. Introduced a view-dependent 3D pointer technology based on the mouse, incorporating depth adaptation to address binocular disparity and perspective issues.
  2. Utilized a mathematical model to analyze the usable range of mouse CD Gain in VR environments, addressing sensitivity issues.
  3. Achieved seamless switching between 2D and 3D spaces without altering mouse control consistency, enhancing the user experience of using a mouse in VR workspaces.

• Implementation Steps and Key Techniques:

  1. Used a ray-casting method to represent cursor direction, converting mouse displacement into angular displacement to update the cursor position.
  2. Introduced Voronoi diagrams and Laplacian interpolation-based methods to dynamically adjust depth in object-less spaces traversed by the cursor.
  3. Adapted and extended the existing CD Gain model for VR environments, calculating the compatibility range between devices and display resolutions.
  4. Conducted user experiments to test the performance of the new method compared to existing Perspective Cursor technology.

Research Outcomes

• Specific Results:

  1. The Depth-Adaptive Cursor method significantly improved performance in 3D target selection tasks, reducing task time by approximately 21% and errors by about 48%.
  2. Subjective user feedback indicated that DAC outperformed Perspective Cursor in terms of efficiency, consistency, and comfort.
  3. DAC's advantages were particularly evident in scenarios involving distant and small target selection.

• Advantages Over Existing Solutions:

  • Addressed the lack of cursor depth adaptation in Perspective Cursor, significantly reducing time and errors in target selection.
  • Provided depth-adaptive continuity in scenarios with large depth ranges and small targets, greatly reducing errors caused by binocular disparity.

• Experimental or Evaluation Results:

  • In 3D pointer tasks, DAC reduced completion time by 21.21% and errors by 48.25% compared to PC.
  • In data analysis tasks, DAC and PC showed similar performance for large targets and 2D interfaces, but users preferred DAC.
  • Users reported higher control consistency and better small-target selectability with DAC.

• Limitations and Future Directions:

  • Limitations:
    1. The technology was only evaluated on static targets in fixed settings, lacking research on dynamic targets and complex tasks.
    2. The user group primarily consisted of males, necessitating broader sampling in the future.
    3. The effect of cursor depth adaptation may be more pronounced on high-resolution HMDs.
  • Future Directions:
    • Explore alternative algorithms for cursor depth interpolation, such as integrating Bubble Cursor's proximity-based adaptation mechanism.
    • Evaluate DAC's application in dynamic task scenarios, such as 3D object manipulation and virtual collaboration tasks.
    • Extend DAC to AR devices for interaction with physical environments, such as selecting physical objects or operating mixed-reality interfaces.