XRgonomics: Facilitating the Creation of Ergonomic 3D Interfaces

Title of the Paper

XRgonomics: Facilitating the Creation of Ergonomic 3D Interfaces

Paper Information

• Subject Area: Human-Computer Interaction, 3D User Interface Design, Augmented Reality and Virtual Reality
• Keywords: 3D User Interface, Ergonomics, Toolkit, Computational Interaction, Optimization, Adaptive User Interface, Mid-Air Interaction

Research Background and Problem

• Existing Issues:

  1. In cross-reality (XR) applications, users often experience arm discomfort due to prolonged mid-air interaction.
  2. Current 3D user interface designs lack dedicated tools and guidelines, often constrained by 2D UI design principles.
  3. Existing ergonomic metrics are primarily used to evaluate existing interactions rather than to design new interfaces.
  4. Traditional design guidelines fail to adapt to the dynamic interaction environments required by XR applications.

• Significance: Exploring ergonomic issues in mid-air interactions within user scenarios can help optimize user experience, reduce fatigue, and improve interaction efficiency.

• Research Motivation and Related Work:

  1. Literature review indicates that designers struggle with addressing physical constraints in XR experiences, such as user posture design and fatigue reduction.
  2. Previous studies have proposed muscle activation simulations and fatigue models, but these methods are often too complex to be applied in practical interface design.

Proposed Solution

• Proposed Tool: XRgonomics Toolkit.

• Innovations:

  1. Utilizes a physiological model of the user's arm to calculate the "ergonomic cost" of each position in the interaction space and visualizes it in real-time.
  2. Developed a GUI that allows designers to dynamically explore the interaction space, using color coding to indicate low-cost and high-cost areas.
  3. Provides an API enabling developers to create adaptive 3D UIs based on real-time data.

• Implementation Steps:

  1. Discretization of Interaction Space: Generates a 3D grid (voxels) based on the user's arm movement range.
  2. Arm Posture Calculation: Uses inverse kinematics to calculate possible arm postures and optimal postures for each voxel.
  3. Ergonomic Cost Calculation: Evaluates interaction cost using metrics such as "Cumulative Endurance (CE)," Rapid Upper Limb Assessment (RULA), and biomechanical models.

Research Outcomes

• Specific Outcomes:

  1. Developed the XRgonomics toolkit, integrating GUI and API to provide intuitive ergonomic data for 3D UI designers.
  2. Proposed two application scenarios: optimizing the placement of static UIs and dynamically adjusting UIs to adapt to user perspectives or scene changes.

• Advantages:

  1. Compared to traditional guidelines, XRgonomics enables more intuitive design based on interaction space data.
  2. Offers real-time adaptability to user comfort, enhancing reliability in dynamic environments.

• Experimental or Evaluation Results:

  1. User demonstration experiments confirmed that participants could intuitively understand the visualized data generated by the toolkit and use it to optimize 3D UI designs.
  2. Tests on UI design tasks showed that the toolkit significantly helped designers make optimal choices within constrained conditions.
  3. The API's real-time data query response time was less than 10 milliseconds, making it suitable for real-time application scenarios.

• Limitations and Future Directions:

  1. Limitations:

     • Simplified kinematic chain limits the expressiveness of arm postures (e.g., fixed wrist joint angles).
     • The toolkit does not account for dynamic fatigue changes caused by user motion, focusing only on static postures.
     • Currently supports only arm-related ergonomic metrics, excluding other interaction factors such as vision or cognitive load.

  2. Future Directions:

     • Enhance the complexity of inverse kinematics calculations to support more postures, such as dynamic wrist joint angles.
     • Incorporate user motion and integrate dynamic fatigue and interaction costs into the toolkit.
     • Expand the toolkit to cover vision, cognition, and spatial relationships between physical/virtual objects.
     • Integrate the toolkit into existing development environments (e.g., Unity IDE or MRTK) to improve usability.

Conclusion

This paper presents an innovative approach through the development of the XRgonomics toolkit, assisting designers in optimizing 3D user interfaces in XR applications, reducing fatigue during mid-air interactions, and enhancing comfort. Although the toolkit has room for improvement, its effectiveness has been validated through experiments, providing significant reference value for future research and practice.