SpinOcchio: Understanding Haptic-Visual Congruency of Skin-Slip in VR with a Dynamic Grip Controller

Title of the Paper

SpinOcchio: Understanding Haptic-Visual Congruency of Skin-Slip in VR with a Dynamic Grip Controller

Paper Information

• Research Domain: Virtual Reality (VR), Haptic Interaction and Devices, User Perception Studies
• Keywords: Haptics, Skin-Slip, Normal Force, Controller, Virtual Reality, User Study, Visual-Haptic Congruency, Multimodal Interaction

Research Background and Problem Statement

Existing Issues and Research Significance

• Integration of Haptics and Vision in Virtual Reality: In enhancing virtual reality experiences, haptic feedback, especially when congruent with visual feedback, can significantly improve the sense of realism in interactions. However, prior studies have shown that even when haptic feedback is incongruent with visual feedback, the dominant role of vision in perception may diminish reliance on haptics.
• Potential of Skin-Slip Feedback: Although previous devices (e.g., Haptic Revolver) have been developed to generate skin-slip feedback, their application remains limited to single-finger interactions with fixed directions. Thus, the potential of skin-slip feedback in multi-finger interactions remains underexplored.

Research Motivation and Objectives

• To design and explore a haptic device with higher degrees of freedom for generating skin-slip feedback and simulating the sensation of virtual objects sliding across the fingertips.
• To investigate how the congruency between haptic and visual feedback in virtual environments affects users' perception of realism.

Solution

Methods and Innovations

• Development of SpinOcchio, a handheld haptic device that generates skin-slip feedback between two opposing fingers using rotating and swinging discs.
  • Key Technologies:
    • Control of disc rotation and swinging modules to generate skin-slip in arbitrary directions.
    • Dynamic adjustment of grip width (normal force) to simulate changes in virtual object thickness.
    • Integration with visual cues to present dynamic tactile experiences of virtual objects sliding, rotating, or remaining stationary.
• The innovation lies in its ability to simultaneously act on two fingertips, providing comprehensive 6-degree-of-freedom skin-slip feedback.

Implementation Steps

1. Device Design and Technical Realization: SpinOcchio utilizes rotating discs combined with servo motors to support dynamic grip width and 360° omnidirectional skin-slip. The device is handheld and incorporates HTC VIVE for motion tracking.
2. Preliminary Validation and Parameter Testing:
   • Measurement of device input-output latency.
   • Testing device performance reliability under user-applied grip forces.
3. User Studies and Experimental Design:
   • Study 1: Testing the minimum discernible difference (JND) in skin-slip direction perception under single-finger and dual-finger conditions.
   • Study 2: Exploring the congruency between haptic and visual perception in virtual environments.
   • Study 3: Evaluating the device's impact on immersion and realism during free interaction in virtual scenarios.

Research Findings

Key Experimental Results

1. Study 1 - Threshold for Skin-Slip Direction Perception:

   • The discrimination threshold for skin-slip direction under single-finger conditions was 43.79°, while under dual-finger conditions it was 66°, indicating lower spatial precision in dual-finger interactions.
   • The reduced directional discrimination ability may be related to a "suppression interaction effect" in perception.

2. Study 2 - Haptic and Visual Perception Congruency:

   • In the presence of visual feedback, participants rated the congruency between visual and haptic feedback highly, even when the direction of haptic feedback was incongruent with visual feedback. This suggests that vision plays a dominant role in multimodal perception.

3. Study 3 - Realism and User Experience:

   • Comparing dynamic grip width adjustment (dynamic feedback) with fixed grip width (static feedback), participants showed no significant difference in realism and immersion ratings between the two conditions.
   • Most participants preferred dynamic objects, finding them more engaging and focusing more on perception.

Advantages Compared to Existing Solutions

• High-Degree-of-Freedom Skin-Slip Feedback: Supports 6-degree-of-freedom skin-slip and is applicable to dual-finger interactions, surpassing traditional single-finger devices.
• Dynamic Grip Width Simulation: Enables dynamic adjustment of normal force to simulate changes in object shape and thickness.
• Deep Integration with Virtual Scenarios: The combination of haptics and vision enhances the realism of virtual object interaction simulation.

Limitations and Future Directions

• Hardware Limitations:
  • The current device is relatively large and heavy, making it less suitable for users with smaller hands.
  • The flat disc design is unable to generate curved surface or edge sensations.
• Study Design:
  • Limited sample size may result in insufficient statistical power.
  • More standardized evaluation scales are needed for assessing user perception.
• Future Research Directions:
  • Optimize device size and weight, and explore designs better suited for wearable forms.
  • Expand application scenarios, such as remote healthcare, dual-hand interactions, and game simulations.
  • Investigate the integration mechanisms of vision and haptics in complex interaction tasks with larger sample sizes.

Conclusion

SpinOcchio is an innovative haptic device that effectively simulates dynamic skin-slip and grip force perception, enhancing the congruency between haptic and visual experiences in virtual reality. Despite hardware and study design limitations, its findings provide a foundation for the development of next-generation haptic VR devices and multimodal perception research.