Big or Small, It’s All in Your Head: Visuo-Haptic Illusion of Size-Change Using Finger-Repositioning

Title of the Paper

Big or Small, It’s All in Your Head: Visuo-Haptic Illusion of Size-Change Using Finger-Repositioning

Paper Information

• Subject Area: Haptic perception and pseudo-haptic feedback in virtual reality
• Keywords: haptic perception, pseudo-haptics, visuo-haptic integration, size illusion, hand interaction, virtual reality, user study, dynamic object size

Research Background and Problem Statement

• Identified Problems or Challenges

  1. Current haptic feedback technologies simulate the size of virtual objects by altering physical shapes or using wearable devices. However, these methods are constrained by the physical limitations of hardware, making it difficult to flexibly simulate dynamic size changes, such as objects shrinking or growing.
  2. Existing deformable devices are often bulky and power-intensive, making it challenging to achieve rapid dynamic size changes.

• Significance of the Problem Enhancing haptic feedback can improve the immersive experience in virtual reality (VR), especially for dynamic object size changes (e.g., expanding muscles or contracting organisms). In gaming and entertainment, such haptic perception can significantly enhance the realism of user interactions.

• Motivation and Related Work

  1. Research on pseudo-haptics has shown that visual cues significantly influence haptic perception, but most studies in this field focus on static objects or a limited range of dynamics.
  2. To address the limitations of physical hardware, it is worth exploring the combination of fingertip repositioning devices and visual feedback to create haptic illusions.

Proposed Solution

• Innovative Approach

  1. A novel method is proposed to create a visuo-haptic illusion of dynamic size changes in virtual objects through fingertip repositioning.
  2. A fixed-size hardware device with rotating rings was developed to guide tactile feedback by repositioning users' fingers.
  3. By integrating visual and haptic cues, users' perception of fingertip repositioning is guided to interpret it as dynamic size changes in virtual objects.

• Innovative Aspects of the Solution

  1. The method avoids dynamic physical alterations of hardware, overcoming the physical limitations of existing deformable devices.
  2. By leveraging visual context, fingertip repositioning is mapped to pseudo-haptic size changes, enabling the simulation of a range much larger or smaller than the device's actual size.
  3. By combining visual illusions and haptic stimuli, this is the first demonstration of an extended perception range from smaller-than-device to larger-than-device sizes.

• Implementation Steps and Key Techniques

  1. Hardware Design
     • A handheld device with four stacked rotating rings was developed, allowing individual repositioning of four fingers.
     • Closed-loop motor control was employed to precisely adjust the rotation speed and position of the rings.
  2. User Study Design
     • Study 1: Investigated whether fingertip repositioning alone, without visual cues, could lead to perceived size changes.
     • Study 2: Explored the impact of fingertip repositioning combined with dynamic visual cues on the perception of virtual object size changes.
  3. Pseudo-Haptic Hypothesis
     • By exploiting the mismatch between visual and haptic inputs, dynamic visual feedback of virtual objects enhances users' perception of size changes.

Research Outcomes

• Specific Results

  1. Hardware Performance:
     • The device achieved a maximum rotation speed of 46.1 mm/s and a maximum torque of 0.7 N·m, enabling smooth fingertip repositioning.
     • Evaluations confirmed that the device is flexible, lightweight, and capable of supporting various dynamic interactions.
  2. User Experiment Results:
     • Study 1: Without visual cues, users could not perceive significant size changes and consistently perceived the controller as having a fixed size of approximately 141.4%.
     • Study 2: With visual feedback, perceived virtual object sizes increased to 301.8% or decreased to 97.2%, validating that fingertip repositioning combined with visual context successfully simulated a wide range of size changes.
  3. Pseudo-Haptic Effects:
     • The same set of haptic cues could be mapped by users to two opposite perceptual effects (size increase and decrease).
  4. Subjective Feedback:
     • Some users reported being fully convinced of the device's dynamic size changes, even believing that the physical size of the device had actually changed during the experiment.

• Advantages Compared to Existing Solutions

  1. Does not require dynamic alteration of device shape, avoiding the complexity of mechanical structures for size changes.
  2. Capable of real-time simulation of a wide range of virtual object size dynamics (from 44.2% smaller to 160.4% larger).
  3. The method is more lightweight, faster, and energy-efficient compared to fully mechanical solutions.

• Limitations and Future Directions

  1. Limitations:
     • Strong reliance on visual cues; the illusion effect may weaken when users look away.
     • The current device supports size changes along a single axis only, lacking support for multidimensional object deformations.
     • The magnetic fixation of users' fingertips may be uncomfortable, limiting practicality.
  2. Future Directions:
     • Incorporate synchronized cues from other senses (e.g., sound) into visual feedback to enhance the robustness of the illusion.
     • Explore haptic illusions for other object properties (e.g., weight, stiffness).
     • Design multi-degree-of-freedom devices to achieve more complex dynamic shape changes.

Potential Application Areas

1. Realistic Simulation:
   • Use fingertip repositioning to simulate pressure changes in hoses or muscle expansion, enhancing immersion in virtual training scenarios.
2. Gaming Interaction:
   • Dynamic interaction experiences such as upgrading or transforming combat weapons (e.g., an axe growing into a giant sword).
   • Real-time size changes of magical items in games, enhancing the fantasy experience in virtual worlds.
3. Other Possible Directions:
   • Combine tactile feedback with non-size-related properties (e.g., material changes, force feedback) to expand potential interactive applications.

This study provides an innovative, lightweight, and cost-effective solution for implementing dynamic haptic interactions in virtual reality environments.