Investigating Wrist Deflection Scrolling Techniques for Extended Reality

Title of the Paper

Investigating Wrist Deflection Scrolling Techniques for Extended Reality

Paper Information

• Subject Area: Human-Computer Interaction and Extended Reality Technology
• Keywords: scrolling, wrist deflection, controller-free, wristband, extended reality, virtual reality, position control, rate control, user study

Research Background and Problem Statement

• Problem Statement:

  1. Current scrolling interaction methods in XR (Extended Reality), such as handheld controllers or gesture controls, have limitations including excessive hand strain or specific arm posture requirements.
  2. Users demand flexible and burden-free scrolling techniques across various scenarios.
  3. More specific and user-friendly scrolling methods are needed to overcome challenges in social acceptability and continuous operation in existing interfaces.

• Significance: As a fundamental interaction form, optimizing scrolling can be widely applied to multitasking scenarios such as browsing shopping lists or selecting music, enhancing the breadth and depth of XR technology applications.

• Research Motivation and Related Work:

  • Related literature primarily focuses on hand controls and visual gestures, with limited research on scrolling input via "wrist deflection."
  • Wrist deflection has the potential to serve as an independent gesture, enabling scrolling input without relying on hand load.
  • The authors summarize and incorporate previous studies on ergonomics, rotational control techniques, and tilt input devices as the theoretical foundation.

Proposed Solution

• Proposed Methods: Two novel scrolling techniques based on wrist deflection:

  1. Wrist Joystick: Similar to a joystick, enabling rate-controlled content scrolling.
  2. Wrist Drag: Similar to touchscreen drag, enabling position-controlled content scrolling.

• Innovations:

  • The proposed scrolling techniques leverage "wrist deflection angles" to achieve free interaction and posture-independent XR scrolling input for the first time.
  • A comparative analysis of the advantages and disadvantages of rate control versus position control interaction modes, paving the way for scenario-specific scrolling solutions.
  • Specially designed wrist deflection measurement methods to optimize ergonomics and scrolling precision.

• Implementation Steps and Key Technologies:

  1. Method Design: Two rounds of preliminary experiments to optimize the gain function and layout for scrolling input.
  2. Experimental Validation: Comparing the two wrist-based techniques while introducing two existing scrolling systems as benchmarks.
  3. Data Collection: Using infrared-based time-of-flight sensors to detect wrist deflection angles, combined with virtual reality device experiments.
  4. User Study:
     • Designing two types of tasks: rapid target scrolling tasks and slow counting scrolling tasks.
     • Dividing the experiment into two major postures: "arm extended forward" and "arm placed at the side," to explore the impact of posture on performance.

Research Outcomes

• Specific Findings:

  • In rapid target scrolling tasks, the position control method (Wrist Drag) outperformed the rate control method (Wrist Joystick).
  • For prolonged scrolling tasks, the rate control method (Wrist Joystick) was more suitable and required less physical effort from users.
  • Wrist deflection scrolling techniques performed more stably in the "arm placed at the side" posture, with no significant decline in task performance.

• Advantages Over Existing Methods:

  • Task performance was comparable to traditional controller-based scrolling methods (Controller Joystick) and gesture-based scrolling methods (Arm Drag).
  • Provided a complete hands-free interaction method, unrestricted by arm posture.

• Experimental or Evaluation Results:

  1. Wrist scrolling techniques demonstrated higher precision and smoothness in small-range target scrolling tasks.
  2. User preferences varied depending on the scrolling scenario, with some favoring the intuitive nature of rate control mode, while others preferred the flexibility of position control mode.
  3. Analysis of wrist movement paths during scrolling revealed that some users' paths deviated from the ideal suggested path, emphasizing the need for future designs to consider personalized adjustments.

• Limitations and Future Directions:

  • The current experiment focuses on the "scrolling" functionality; future studies should explore how wrist deflection can be applied to multidimensional interactions (e.g., zooming).
  • Further validation is needed on the impact of prolonged use of this technology on user fatigue.
  • The study is limited to virtual scenarios in laboratory settings; future work should extend to real-world mixed reality environments.
  • Further optimization of sensor hardware accuracy is necessary to better support finer and more complex interaction scenarios.