SkinHaptics: Exploring Skin Softness Perception and Virtual Body Embodiment Techniques to Enhance Self-Haptic Interactions

Research Background and Issues

• Problems and Challenges: Providing haptic feedback for soft deformable objects requires complex mechanical hardware and rendering software. Even high-end devices struggle to render high-resolution soft feedback. Human tactile perception and existing haptic rendering frameworks have yet to fully address these challenges.
• Significance: Delivering realistic haptic feedback in virtual reality can greatly enhance immersion, but current methods are difficult to widely adopt due to high costs and technical complexity.
• Research Motivation and Related Work: The authors propose a self-haptic method (SkinHaptics) that provides haptic feedback through the user's own body, eliminating the need for complex mechanical hardware. Previous research has mainly explored the potential of the human body as a dynamic interface, but understanding of skin softness and hardness perception remains insufficient. Moreover, there is no unified consensus on the optimal visual representation of virtual entities for self-haptic experiences.

Solution

• Proposed Approach: SkinHaptics is a device-free haptic feedback method that achieves soft object haptic feedback by altering the musculoskeletal state of the hand and the visual representation of the virtual hand and objects.
• Innovations:
  • Introducing the concept of using the user's hand to represent different softness levels of virtual objects for the first time.
  • Exploring the impact of virtual embodiment on haptic experiences by reducing users' tactile perception of their own hands through system-designed visual representations.
  • Providing new scientific data, such as skin softness measurements and thresholds for hardness discrimination.
• Implementation Steps and Techniques:
  • Experiment 1: Measure the skin hardness (Shore hardness OO) of different hand postures and contact points.
  • Experiment 2: Evaluate users' ability to perceive differences in softness and hardness in haptic feedback (discrimination thresholds and Weber fractions).
  • Experiment 3: Investigate the impact of virtual hand-object visual representations on haptic experiences, including four visual representation methods (virtual object, object overlapping with hand, object offset from hand, and object separated from hand).

Research Outcomes

• Specific Findings:
  • The hardness range of hand skin is Shore hardness OO 15-68, with most hand postures showing consistency and low inter-individual variability.
  • Users demonstrate good discrimination ability for changes in softness and hardness in haptic feedback, with a discrimination threshold of Shore hardness OO 3.1 and a Weber fraction of 12.4%, enabling differentiation of up to six levels of hardness.
  • In the study of virtual embodiment and hand-object visual representations, reducing virtual embodiment of the hand (e.g., object separated from hand) significantly improved haptic experiences.
• Advantages:
  • Compared to traditional mechanical haptic devices, SkinHaptics is more cost-effective and does not require complex hardware.
  • Provides a self-haptic method capable of expressing softness and hardness differences with low complexity and high flexibility.
• Experimental Results:
  • The visual representation of object offset from the hand was rated as the most preferred and effective method; visual offsets greater than 6.5 cm effectively reduced users' sense of virtual embodiment.
  • Close alignment with visual feedback (e.g., object surface deformation) enhanced tactile perception, even in the absence of direct physical touch.
• Limitations and Future Directions:
  • Individual Differences: Variations in individuals' skin physiology may affect the consistency of haptic feedback.
  • Limited Expressive Capability: SkinHaptics cannot fully represent certain ranges of material properties (e.g., Shore hardness OO 40-60) and may require external items such as smartwatches, rings, or gloves.
  • External Factors: Environmental temperature and the potential of other body areas remain underexplored.
  • Future Research Directions: Incorporating gesture-guiding devices or advanced hand posture recognition models, exploring the haptic potential of other body areas, and investigating the effects of smoothness and temperature on tactile perception.

Through these studies and data, the authors provide new perspectives and practical guidance for self-haptic design, contributing to the advancement of haptic feedback in virtual reality.