InflatableBots: Inflatable Shape-Changing Mobile Robots for Large-Scale Encountered-Type Haptics in VR

Document Title

InflatableBots: Inflatable Shape-Changing Mobile Robots for Large-Scale Encountered-Type Haptics in VR

Document Information

• Research Area: Virtual Reality (VR), Haptic Interaction, Shape-Changing Interfaces, Robotics
• Keywords: Virtual Reality, Haptics, Inflatable Devices, Mobile Robots, Encountered-Type Haptics, Shape-Changing Interfaces

Research Background and Problem Statement

• Identified Problems or Challenges:

  • Current haptic interaction devices are mostly small-scale, such as those simulating handheld objects, whereas large-scale "encountered-type" haptics can enhance full-body immersive experiences.
  • Traditional inflatable shape-display technologies are safe, low-cost, and suitable for large-scale interactions, but they lack autonomous mobility, limiting the interaction area.
  • Increasing the scale of inflatable displays introduces complexity in modules and control, reducing deployability.
  • Insufficient capability for continuous surface rendering makes it difficult to simulate large-scale realistic objects.

• Significance of the Research:

  • Providing realistic haptic feedback in virtual reality is key to enhancing user immersion.
  • Safe, scalable, and easily deployable large-scale haptic technologies can significantly improve interaction quality and expand application scenarios.

• Motivation and Related Work:

  • Previous studies have explored haptic devices based on mobile robots or shape-changing displays, but both have limitations: the former struggles to present complex shapes, while the latter lacks mobility.
  • This research aims to combine mobile robots with inflatable structures to expand haptic rendering capabilities while addressing deployment and interaction area limitations.

Solution

• Proposed Method or Solution:

  • Developed a system called "InflatableBots," which integrates mobile robots with inflatable shape-changing structures, allowing robots to dynamically change height and position.
  • Through the coordinated operation of multiple robots, the system simulates large-scale haptic scenes with various virtual objects and surfaces.

• Innovations:

  • Combines inflatable shape-changing technology with omnidirectional mobile robots, overcoming the limitations of static display systems.
  • Achieves rapid dynamic shape changes (from 40 cm to 200 cm in height, at a speed of 10.4 cm/sec) combined with high agility (horizontal speed of 58.5 cm/sec).
  • The system features both mobility and safety, excelling in simulating multi-point haptics, continuous surfaces, and changing shapes.

• Implementation Steps and Key Technologies:

  • Hardware Design:
    • Omnidirectional mobile robot base (Nexus Robot 4WD) equipped with a fan-driven, reel-based inflatable structure.
    • The inflatable module uses a fan inflation mechanism, supporting rapid shape changes and vertical movement.
  • Software Control:
    • VR scenes are created in Unity and integrated with the HTC VIVE system to monitor and control robot positions and heights in real time.
    • Path planning is based on the RVO algorithm to ensure robots synchronize with user movements.
    • Vertical height is calculated based on virtual object surfaces, with robot movements and inflation processes managed via wireless microcontrollers.

Research Outcomes

• Specific Results:

  • Successfully implemented dynamic simulation of large-scale multi-point haptic objects and surfaces using inflatable robots.
  • Conducted multiple user studies and technical evaluations, validating the system's deployability, safety, and improvements in user experience for virtual-physical haptic interaction.

• Advantages Over Existing Solutions:

  • Combines the flexibility of inflatable structures with the high scalability of omnidirectional robot mobility.
  • Supports rapid continuous haptic rendering, expanding the application scenarios of traditional static displays.
  • The system is low-cost and portable, making it suitable for large-scale deployment.

• Experimental or Evaluation Results:

  • Technical Evaluation:
    • Haptic rendering speed and height control were precise, with a horizontal position error of 1.0 cm and a rotational error of 0.7°.
    • Maximum pushing force varied with height (1.007 N at 200 cm).
    • Overall system latency was 111 ms, with a tracking loss rate of approximately 4.07%.
  • User Studies:
    • Comparatively, users found the haptic experience of "InflatableBots" significantly better than no-haptic conditions, though still inferior to real objects.
    • Users particularly appreciated the system's performance in rendering smooth surfaces and multi-point objects.

• Limitations and Future Directions:

  • The hardness and surface texture of the device's top limit its ability to simulate hard or complex-textured objects.
  • Coordination in multi-robot simultaneous operation and path planning requires further optimization.
  • Noise and stability issues can be addressed in the future with more efficient hardware and materials.

Conclusion

InflatableBots offers an innovative solution by integrating inflatable shape-changing technology with mobile robots for large-scale virtual reality haptic interaction. This system significantly extends the boundaries of immersive virtual experiences and demonstrates rich potential for future optimization and applications.