QuadStretcher: A Forearm-Worn Skin Stretch Display for Bare-Hand Interaction in AR/VR

Title of the Paper

QuadStretcher: A Forearm-Worn Skin Stretch Display for Bare-Hand Interaction in AR/VR

Paper Information

• Field of Study: Haptic feedback technology in Human-Computer Interaction and Augmented/Virtual Reality (AR/VR)
• Keywords: haptics, wearable, skin stretch, AR, VR, bare-hand interaction

Research Background and Problem Statement

• Challenges and Problems:

  • With advancements in hand-tracking technology, many AR/VR devices now support bare-hand interaction. However, providing tactile feedback to enhance immersion remains challenging in practical applications.
  • Traditional haptic devices, such as handheld or wearable devices, are not suitable for bare-hand interaction scenarios.
  • Tactile feedback on the wrist/forearm has been proposed as an alternative, but many devices are limited to single-degree-of-freedom (1-DoF) feedback, making it difficult to convey the force direction or dynamics required in more complex multi-degree-of-freedom (3-DoF) interactions.

• Research Motivation:

  • To develop a lightweight device that does not require a grounded support structure, capable of delivering complex 3-DoF dynamic force directions in immersive bare-hand interactions.
  • To address the limitations of existing devices (e.g., Tasbi) in expressing force direction and dynamic forces, thereby creating more realistic and nuanced tactile feedback for AR/VR interaction scenarios.

• Related Work:

  • Recent studies have proposed using pressure, vibration, or skin stretch to provide "substitute tactile feedback" on the forearm. However, these methods have not effectively conveyed dynamic force directions.
  • Devices like Tasbi, which provide wrist-based vibration and squeezing feedback, have significantly enhanced user immersion in virtual interactions. However, their 1-DoF feedback limits the realism of force expression in complex interactions.

Proposed Solution

• Proposed Solution:

  • The design and implementation of QuadStretcher, a skin-stretch-based device with four independently controlled stretch units surrounding the forearm to simultaneously deliver multi-directional dynamic force feedback.
  • The use of coordinated dual stretch units eliminates the need for a grounded structure, ensuring the device remains lightweight.
  • A design that stretches the skin longitudinally along the forearm axis to mimic the biomechanical characteristics of tendons during hand interactions with real objects.

• Innovations:

  • Supports multi-degree-of-freedom (3-DoF) force feedback.
  • Lightweight design, weighing only 147g and requiring no grounded base.
  • Dynamically adjusts tactile feedback based on user actions to more accurately convey force direction and intensity.

• Implementation Process and Key Technologies:

  • Real-time processing of user hand motion data using the Unity engine, coordinated with Arduino controllers and servo motors for tactile output.
  • The skin stretch module is designed to support a maximum ±11mm displacement without resistance, enabling the expression of complex forces in dynamic interactions.
  • Psychophysical experiments were conducted to measure Just Noticeable Differences (JND) to optimize the recognizability and comfort of stretch feedback.

Research Outcomes

• Specific Findings:

  • QuadStretcher can more accurately convey force directions in 3-DoF interactions through skin stretching, enhancing user immersion.
  • Compared to the Squeezer device, QuadStretcher demonstrates significant advantages in expressing complex force directions and performing in high-degree-of-freedom interaction scenarios.
  • Users rated QuadStretcher significantly higher than Squeezer in multi-degree-of-freedom interaction scenarios such as "stretching a rubber band" and "swinging a tennis racket."

• Experimental and Evaluation Results:

  • In a comparative evaluation involving 20 participants, QuadStretcher outperformed Squeezer in metrics such as "realism," "immersion," "enjoyment," and "force direction perception" in 3-DoF interaction scenarios.
  • However, it did not show significant advantages in 1-DoF interaction scenarios.

• Limitations and Future Directions:

  • Limitations: The device size and stretch unit width remain relatively large, requiring further optimization to reduce its volume.
  • Constraints: The device may slip on certain skin surfaces, necessitating more efficient designs to prevent insufficient friction.
  • Future Directions:
    • Evaluate the device's performance in expressing impact forces (e.g., punching a sandbag or firing a gun).
    • Investigate its impact on quantitative task performance (e.g., pointing speed/accuracy) and its role in purely tactile-guided scenarios.
    • Explore the combination of skin stretch with other forms of tactile feedback (e.g., vibration) to enhance interaction experiences.

Conclusion

As an innovative forearm skin-stretch haptic device, QuadStretcher demonstrates significant potential in enhancing immersive bare-hand experiences in AR/VR. Through insightful design and user evaluations, this study provides valuable references for future forearm tactile solutions, particularly in creating new possibilities for expressing complex dynamic interactions.