Armstrong: An Empirical Examination of Pointing at Non-Dominant Arm-Anchored UIs in Virtual Reality

Title of the Paper

Armstrong: An Empirical Examination of Pointing at Non-Dominant Arm-Anchored UIs in Virtual Reality

Paper Information

• Field: Human-Computer Interaction (HCI)
• Keywords: Virtual Reality, Non-Dominant Arm, Pointing Tasks, Design Guidelines, Human Interaction, 3D User Interface, Bimanual Interaction, Visual and Haptic Feedback, User Experience, AR/VR

Research Background and Problem

• Identified Issues or Challenges:

  • In virtual reality (VR) environments, user interfaces (UIs) anchored to the non-dominant arm expand the possibilities for 3D interaction, but the optimization of these UI layouts remains underexplored.
  • There is a lack of design guidelines for 3D UIs around the non-dominant arm, and critical questions remain unanswered:
    • Which areas of the arm are easiest for users to interact with?
    • How do users perform across different latitudes, heights, and longitudes?
    • How can UI layouts be optimized to reduce interference with users' task flow?

• Significance:

  • With the growing prevalence of augmented reality (AR) and virtual reality (VR), designing body-based UIs has vast application potential.
  • Research on non-dominant arm UIs provides theoretical and practical foundations for improving user experience and task efficiency.

• Motivation and Related Work:

  • Previous studies have partially explored the potential of using the palm or arm surface as input/output devices but have largely focused on adapting traditional UIs to 3D environments, without fully leveraging the 3D space around the user.
  • This paper aims to fill this research gap by optimizing the layout of arm-anchored 3D UIs through experiments and data analysis.

Solution

• Methods and Implementation:

  • The authors designed and conducted a VR experiment to investigate user performance in completing 3D pointing tasks in different regions of the non-dominant arm.
  • Experimental data were analyzed to evaluate the efficiency, comfort, and accuracy of different UI layout regions.
  • The Armstrong design guidelines were proposed, and a Unity plugin was developed to guide UI design.

• Innovations:

  • Proposed a set of design principles for 3D UIs anchored to the non-dominant arm.
  • Systematically constructed throughput (TP) heatmaps around the non-dominant arm.
  • Proposed and validated specific UI layout optimization strategies, expanding the theoretical framework for arm-anchored UI design.
  • Introduced an automated development tool (Unity plugin) to provide real-time support for design practices.

• Implementation Steps and Key Technologies:

  • Used Vicon motion tracking technology to precisely capture arm and finger movements.
  • Simulated real-world interactions in VR, testing user performance on 72 target positions.
  • Provided quantitative analysis (e.g., TP metrics) and subjective user feedback to generate 3D heatmaps for interaction design.

Research Outcomes

• Specific Findings:

  • The study found that target points closer to the wrist, nearer to the arm's skin, and aligned with the arm's midline yielded higher user interaction efficiency.
  • The final synthesized TP heatmap identified high-efficiency UI layout regions around the arm and low-efficiency areas to avoid.
  • The experimental results culminated in five Armstrong UI design guidelines, demonstrated through a Unity plugin for practical application.

• Advantages Over Existing Solutions:

  • Provided more detailed 3D layout guidance, optimizing UI interaction performance around the arm.
  • Considered contextual differences such as familiarity and task difficulty, better aligning with dynamic user needs.
  • The Unity plugin reduced designers' workload, making 3D interface layouts more intuitive and efficient.

• Experimental or Evaluation Results:

  • Quantitatively, the front side of the arm, areas near the wrist, and regions close to the skin achieved the highest TP values.
  • In the absence of prior knowledge of target positions (unknown mode), pointing efficiency was low; efficiency significantly improved when target positions were known (known mode).
  • Subjective user feedback aligned with TP quantitative data, enhancing the practical relevance of the design guidelines.

• Limitations and Future Directions:

  • Limitations: The experiment was conducted solely in VR environments, leaving the impact of factors like skin color and clothing in AR environments unverified.
  • Future Directions:
    • Expand research variables to improve spatial resolution in human interaction studies.
    • Test more complex interactive controls (e.g., sliders or dropdown menus) for layout optimization.
    • Adapt existing guidelines for AR hardware and explore multi-context applications.

This study systematically analyzed the interaction performance of non-dominant arm-anchored UIs, combining experimental research with design tools to provide valuable insights for AR/VR UI optimization.