Effects of Device Environment and Information Layout on Spatial Memory and Performance in VR Selection Tasks

Document Title

Effects of Device Environment and Information Layout on Spatial Memory and Performance in VR Selection Tasks

Document Information

• Subject Area: Human-Computer Interaction, the impact of virtual reality environments on user performance and spatial memory
• Keywords: Virtual reality, spatial memory, selection performance, immersion, human-computer interaction, information layout, input devices, user experience, foundational tasks, user preferences

Research Background and Issues

• Identified Problems or Challenges:

  • There is limited research on whether virtual reality (VR) environments can effectively support conventional computing tasks (e.g., navigation, selection).
  • Existing studies on VR's impact on spatial memory yield inconsistent results; some suggest it enhances memory, while others fail to confirm this.
  • There is a lack of detailed research on how device interaction characteristics and information layout in VR environments affect basic task performance.

• Importance of the Issue:

  • As VR technology becomes more widespread, including applications like virtual desktops, understanding its impact on basic task performance and user experience is critical.
  • Improving task efficiency and user experience in everyday computing tasks (e.g., visual search, selection, reselection) will determine whether VR is suitable for these tasks.

• Research Motivation and Related Work:

  • Motivation: To explore whether increased immersion improves spatial memory and operational performance, while also understanding user experiences and preferences regarding VR devices and layouts.
  • Related Work Review:
    • Early studies found that VR could enhance spatial memory through head-mounted displays (HMDs) or panoramic views.
    • Recent investigations into spatial memory formation in 2D vs. 3D information layouts show mixed results, with no consistent advantage for 3D.
    • Evaluations of input devices indicate that traditional mice often outperform VR controllers, though higher-degree-of-freedom controllers may excel in specific tasks.

Solution

• Proposed Solution:

  • Conduct controlled experiments to compare the effects of different device types (HMD + controller vs. desktop + mouse) and information layouts (Wrap, Flat-near, Flat-far) on user performance and spatial memory.
  • Test metrics include task completion time, error rate, spatial memory accuracy, immersion, and user preferences.

• Innovations:

  • Propose a quantitative evaluation of immersion across multiple dimensions, including view control mechanisms, scene layout, field of view, and visual depth.
  • Use multiple performance metrics (e.g., selection time, memory accuracy) to comprehensively analyze the trade-offs of immersion.
  • Investigate the gap between user preferences and actual performance, revealing conflicts between "subjective experience" and "operational efficiency."

• Implementation Steps:

  1. Testing Platform: Develop a Unity environment compatible with both HMDs and desktops.
  2. Set Up Three Layouts:
     • Wrap: Content surrounds the user.
     • Flat-near: Wall-mounted arrangement at a closer distance.
     • Flat-far: Wall-mounted arrangement viewed from a distance.
  3. Perform Three Task Types:
     • Selection Task: Locate and select target icons.
     • Memory Task: Select the original location of hidden targets.
     • Baseline Task (Fitts’ Law): Calibrate device performance differences, isolating pure pointing time.
  4. Collect User Feedback: Include immersion scales, NASA-TLX workload questionnaires, and device preference surveys.

Research Findings

• Findings:

  • Immersion: HMD devices significantly increased immersion scores, and the Wrap layout provided higher immersion than Flat layouts.
  • Spatial Memory:
    • No significant differences in memory accuracy across conditions (~90%).
    • Immersive conditions did not significantly enhance spatial memory.
  • Selection Performance:
    • The Wrap layout was 33% slower than Flat-far, and the HMD environment was 14% slower than the desktop.
    • The Flat-far layout performed best, with the shortest selection time.
  • User Preferences:
    • Most users believed HMDs were better for learning content locations (24/30), despite lower performance.
    • Users preferred the immersive Wrap layout, especially in HMD environments.

• Advantages Compared to Existing Solutions:

  • Provides systematic experimental evidence on the impact of varying levels of immersion on task performance in VR.
  • Clearly identifies potential trade-offs between immersion and efficiency, offering practical recommendations for designers.

• Experimental or Evaluation Results:

  • HMDs were more time-consuming than desktops, but users enjoyed the immersive experience more.
  • While Wrap increased immersion, it significantly reduced selection efficiency, whereas Flat-far excelled in performance.

• Limitations and Future Directions:

  • Limitations:
    • Limited number of task targets, failing to reflect the complexity of real-world usage.
    • Use of virtual icon arrangements lacks validation in real UI scenarios.
    • Short experiment duration prevents evaluation of long-term memory and skill development.
  • Future Directions:
    1. Investigate the impact of more targets and complex layouts on results.
    2. Extend experiments to real UI design contexts, testing broader application scenarios.
    3. Examine the performance improvements of HMD scenarios with enhanced input devices (e.g., mouse enhancements).
    4. Explore the effects of long-term use on memory retention, efficiency, and subjective experience.