Visuo-haptic Illusions for Linear Translation and Stretching using Physical Proxies in Virtual Reality

Title of the Paper

Visuo-haptic Illusions for Linear Translation and Stretching using Physical Proxies in Virtual Reality

Paper Information

• Subject Area: Interaction Design, Virtual Reality, Haptic Feedback Systems
• Keywords: Virtual Reality, Haptic Interfaces, Physical Proxies, Visuo-haptic Illusions, Linear Translation, Linear Stretching

Research Background and Problem

• Research Background:
  • The rapid development of Virtual Reality (VR) technology has enabled immersive sensory experiences. However, due to the inherently virtual nature of physical properties of virtual objects, users cannot genuinely touch or perceive tactile feedback from these objects.
  • Storing tactile information for virtual objects presents a significant challenge, particularly when it involves multifunctional and manipulable object properties (e.g., extension, stretching, rotation).
• Research Problem or Challenge:
  • How to enhance interaction with virtual objects using fewer physical proxy objects through visuo-haptic illusions.
  • Determining the threshold within which the differences between physical and virtual objects (e.g., length discrepancies) are minimized when physical proxies are limited.
  • Whether visuo-haptic illusions can successfully simulate linear translation and stretching for manipulable physical components and virtual objects.
• Research Significance:
  • Exploring VR haptic interaction extension technologies can reduce the need for high-cost physical prototypes, enabling more interactive devices to achieve functionality through shared proxies.
  • Enhancing the sense of natural interaction and immersion in virtual environments.
• Research Motivation and Related Work:
  • Current studies focus on the use of physical proxies to convey partial attributes of virtual objects (e.g., size, shape, texture, and weight). However, these proxies often lack multifunctionality and require individual design for each object.

Solution

• Overview of Research Methodology:
  • Investigating the performance of physical proxy objects in simulating linear translation and stretching scenarios through visuo-haptic illusions and manipulation of Control-Display Ratio (C/D).
  • Exploring human sensitivity to displacement and stretching under conditions of visual and tactile inconsistency.
• Innovative Contributions:
  • Proposing the possibility of representing multiple virtual objects through a single manipulable proxy, alleviating the proxy bottleneck in VR environments.
  • Quantifying and extracting a "Conservative Detection Threshold" (CDT) through experiments and providing practical guidelines for implementing this method.
• Implementation Steps and Key Techniques:
  1. Experimental Setup: Developed a proxy device consisting of a physical slider and a stretch-resistant band to simulate sliding and stretching.
  2. Experimental Method: Used a psychophysical "1-up-1-down" adaptive staircase procedure to measure detection thresholds for different movement techniques (linear translation vs. linear stretching) and movement distances (7cm, 14cm).
  3. Data Collection: Recorded metrics such as task completion time, user decision accuracy, movement distance, and speed.
  4. Comparative Analysis: Analyzed the impact of C/D ratios on user interaction performance and statistically examined perceptual differences under conditions of visuo-haptic mismatch.

Research Outcomes

• Experimental Results and Findings:
  • For linear translation, shorter distances (7cm) allowed for a higher discrepancy between virtual and physical object lengths (C/D ratio upper limit of 1.62), while longer distances (14cm) had a lower threshold (C/D ratio of 1.50).
  • When stretching resistance was introduced (linear stretching), user detection sensitivity increased, resulting in lower detection thresholds (C/D ratio of 1.54 for 7cm, 1.42 for 14cm).
  • C/D ratios within the threshold did not significantly degrade task performance, but exceeding the threshold led to errors and inaccuracies (e.g., overshooting target positions).
• Advantages Compared to Existing Solutions:
  • This study not only focuses on overall object manipulation but also quantifies the perceptual range caused by partial functional differences in proxies.
  • Demonstrates that even with some degree of disparity between physical objects and virtual operations, a smooth user experience can be achieved through visual illusions.
• Potential Application Scenarios:
  • Designing multipurpose VR proxies, such as using a single slider to simulate multiple components in a virtual DJ mixer.
  • Extending haptic experiences in games, educational tools, and training simulation environments.
• Limitations and Future Research Directions:
  • Does not cover other forms of proxy manipulation, such as nonlinear object operations (bending, rotation).
  • Further exploration is needed on how individual tactile sensitivity differences among user groups (e.g., background, VR experience) affect responses to illusions.
  • Investigating the effects of integrating other haptic feedback modules (e.g., vibration, force feedback devices) on user perception thresholds in VR.

Conclusion

• This study demonstrates that by adjusting the C/D ratio, visuo-haptic illusions can be successfully introduced in VR to design flexible, cost-effective proxy devices.
• The research provides data-driven support for future haptic proxy design, offering significant insights into optimizing the trade-off between proxy operation range and user perception.