GamesBond: Bimanual Haptic Illusion of Physically Connected Objects for Immersive VR Using Grip Deformation

Title of the Paper

GamesBond: Bimanual Haptic Illusion of Physically Connected Objects for Immersive VR Using Grip Deformation

Paper Information

• Subject Area: Virtual reality interaction technology, development of bimanual haptic controllers
• Keywords: Virtual reality, bimanual interaction, haptic feedback, shape deformation, game immersion

Research Background and Problem

• Identified Problems or Challenges: Haptic controllers in virtual reality (VR) typically focus on single-hand interaction or mechanically locked bimanual controllers. However, mechanically locked controllers struggle to quickly simulate dynamic objects and offer limited support for free movement. Additionally, existing technologies face challenges in creating dynamic and realistic haptic interactions between two hands, such as simulating jump ropes or flexible objects.

• Significance: Enhancing the tactile realism and immersion in VR interactions can significantly improve user experience. Developing devices capable of dynamic changes and providing bimanual haptic feedback is a crucial pathway for designing the next generation of VR controllers.

• Research Motivation and Related Work: The authors were inspired by previous research on bimanual haptic controllers and shape-changing controllers, such as SPR1NG (which uses springs to simulate flexible objects) and Haptic Links (which generates haptic constraints through mechanical connections). Additionally, related work has explored simulating various haptic effects, such as dynamic inertia and object motion, by driving shape deformation within controllers. However, these devices either did not fully focus on bimanual interaction or had limitations in simulating dynamic objects.

Proposed Solution

• Proposed Solution: The authors introduced a bimanual 4-degree-of-freedom (4-DoF) controller called GamesBond, which uses grip deformation technology to simulate virtually connected objects between two hands. This device creates haptic illusions by altering the controller’s bending, twisting, and stretching.

• Innovations:

  1. No physical connection: The controllers are not mechanically locked but still generate the haptic illusion of a physical connection.
  2. Dynamic rendering: Real-time computation and feedback support dynamic objects, such as jump ropes.
  3. Bimanual interaction: The skin motion differences generated by the controller's deformation enhance the sense of coordination between both hands.

• Implementation Steps and Key Technologies:

  1. Mechanical Design:
     • The controller consists of two segments: the top segment can bend, twist, and stretch.
     • Built-in servo motors drive bending through cable mechanisms and enable twisting and stretching via rotational and push-pull mechanisms.
  2. Software Implementation:
     • Real-time computation of the controller’s position and deformation is performed using Unity3D, with a rendering refresh rate of 200Hz.
     • Three types of virtual binding object simulations (rigid, flexible, dynamic) are used to demonstrate different effects.
  3. User Experience Optimization:
     • Visual feedback is combined with physical feedback, and users experience immersion through VR headsets and haptic deformation.

Research Results

• Specific Outcomes:

  1. Technical Evaluation:
     • The controller performed well in positional accuracy, with an average bending error of 0.31° and an average stretching error of 0.08mm.
     • The controller’s response time was within 300ms and could withstand significant user grip forces.
  2. User Evaluation:
     • Tests with 12 participants showed that VR experiences with haptic feedback significantly outperformed those with only visual feedback in terms of realism, immersion, and entertainment.
     • Users acknowledged the device’s ability to simulate the haptic effects of rigid, flexible, and dynamic objects but noted room for improvement in bending range and twisting speed.

• Advantages: Compared to existing bimanual haptic devices, the GamesBond controller does not require physical connections and supports the simulation of dynamic objects, such as jump ropes. This technology holds significant potential for haptic rendering of complex VR objects.

• Experimental or Evaluation Results:

  • Users found the rendering of flexible and dynamic objects to be the most effective, particularly in scenarios involving dynamic ropes or real-time haptic constraints.
  • The deformation mechanism of the device was well-received, though some users suggested that certain visual and mechanical effects could be further refined.

• Limitations and Future Directions:

  • Structural Issues: Limited bending range and potential for skin pinching. Additionally, motor power constraints limit the frequency of dynamic rendering.
  • Design Recommendations: Future iterations could include multiple bending nodes, more powerful motors, a more compact controller structure, and higher refresh rate software feedback mechanisms.
  • Application Expansion: Explore additional application scenarios, such as motion simulation, remote operation, or collaborative interaction.

Conclusion

GamesBond provides a new direction for bimanual interaction design in VR technology, enhancing user experience by combining visual and haptic feedback. Future work could further optimize its hardware design and expand its application domains, driving haptic controllers toward greater immersion and adaptability.