Connected Material Experiences using Bimanual Vibrotactile Crosstalk in Virtual Reality

Paper Title

Connected Material Experiences using Bimanual Vibrotactile Crosstalk in Virtual Reality

Publication Info

• Topic area: Bimanual haptic feedback and material perception in Virtual Reality (VR) using vibrotactile crosstalk.
• Keywords: Bimanual interaction, vibrotactile feedback, virtual reality, material perception, motion-coupled vibration, crosstalk, haptic rendering, connectedness, Dvihastīya, psychophysics.

Background and Problem

• Problem / challenge: Existing VR systems often fail to replicate natural bimanual material interactions, as most vibrotactile rendering approaches focus on single-handed or single-finger feedback. Prior bimanual haptic systems rely on specialized hardware, limiting accessibility and flexibility.
• Significance: Bimanual material perception is crucial for natural and intuitive VR experiences, as humans inherently use both hands to explore material properties like elasticity, flexibility, and torsion.
• Motivation and related work: Previous research has explored vibrotactile feedback for single-handed interactions and specialized hardware for bimanual feedback. However, these approaches lack generalization, accessibility, and the ability to induce a sense of connectedness between unconnected controllers. This paper addresses whether motion-coupled vibrations can create a unified material experience between two hands.

Solution

• Proposed approach: A bimanual motion-coupled vibration algorithm with tunable crosstalk that links two unconnected VR controllers to create a unified material experience.
• Novelty:
  1. Introduction of motion-coupled vibrotactile feedback with tunable crosstalk to induce bimanual material experiences.
  2. Empirical insights into how crosstalk parameters (amplitude, frequency, grains, delay) influence perceptions of connectedness and material qualities.
  3. Development of Dvihastīya, an authoring tool for designing bimanual vibrotactile feedback in VR.
• Procedure and key techniques:
  1. Design of a bimanual vibration algorithm that computes vibrotactile pulses for each hand based on movement and crosstalk parameters.
  2. Psychophysical and qualitative studies to evaluate the effects of crosstalk on connectedness and material perception.
  3. Implementation of Dvihastīya to enable users to design bimanual feedback for virtual objects.

Results

• Concrete findings:
  • Crosstalk alone can induce a strong sense of connectedness between unconnected controllers, with higher levels of crosstalk amplifying the effect.
  • Relative mapping outperformed absolute mapping in producing connected and natural experiences.
  • Different crosstalk parameters mapped onto distinct material perceptions: amplitude for solidity, delay for propagation, grain for discreteness, and frequency for rhythm.
• Advantage over baselines:
  • Eliminates the need for specialized hardware or physical connections, unlike prior systems.
  • Extends motion-coupled vibrotactile rendering from single-point to bimanual interactions.
• Experiments / evaluation:
  • Study 1: Psychophysics study with 16 participants, evaluating connectedness and naturalness across mapping types, crosstalk levels, and movement primitives (stretching, bending, twisting).
  • Study 2: Qualitative study with 12 participants, exploring material associations induced by different crosstalk parameters.
  • Dvihastīya exploration: Five users designed bimanual feedback for virtual objects, demonstrating the tool's usability and flexibility.
• Limitations and future work:
  • Limited exploration of non-amplitude crosstalk effects on connectedness.
  • Reliance on vibrotactile feedback alone, which lacks kinesthetic and proprioceptive cues.
  • Future work includes integrating multimodal feedback, exploring isometric actions, and developing higher-level material-driven authoring tools.

Summary

This paper introduces a bimanual motion-coupled vibration algorithm with tunable crosstalk, enabling unconnected VR controllers to simulate unified material experiences. Two studies demonstrate that crosstalk enhances connectedness and conveys material properties like elasticity and torsion. The Dvihastīya authoring tool allows users to design bimanual vibrotactile feedback for various VR applications. This approach offers a flexible, accessible alternative to hardware-intensive systems, advancing the design of immersive and intuitive bimanual interactions in VR. Future work aims to expand the method's applicability and integrate multimodal feedback.