ShakeSense: An Electrotactile System to Simulate Shaking a Container with Fluid Contents

Paper Title

ShakeSense: An Electrotactile System to Simulate Shaking a Container with Fluid Contents

Publication Info

• Topic area: Haptic rendering for fluid dynamics in virtual reality
• Keywords: Haptic feedback, electrotactile stimulation, virtual reality, fluid dynamics, tactile rendering, Virtual Center of Pressure, fingertip force calculation, ungrounded devices, cutaneous feedback, immersive interaction

Background and Problem

• Problem / challenge: Existing haptic systems struggle to simulate realistic, multidirectional tactile feedback for fluid dynamics in virtual environments. Current methods rely on bulky, grounded devices or simplified models like center-of-mass (CoM) rendering, which fail to capture the nuanced forces of liquid motion.
• Significance: Realistic tactile feedback for fluid interactions can enhance immersion in VR applications such as gaming, training, and rehabilitation, while overcoming the limitations of traditional haptic devices.
• Motivation and related work: Prior work on ungrounded tactile devices has focused on rigid-body interactions or static forces, neglecting dynamic fluid interactions. Electrotactile systems have demonstrated potential for precise cutaneous feedback but have not been applied to simulate fluid dynamics. This paper addresses these gaps by introducing a lightweight, real-time system for fluid-based tactile rendering.

Solution

• Proposed approach: ShakeSense, an electrotactile rendering system that uses a Virtual Center of Pressure (VCoP) and fingertip force calculation pipeline to simulate realistic fluid dynamics sensations.
• Novelty:
  1. A novel cutaneous rendering approach using electrotactile stimulation to simulate fluid dynamics.
  2. An advanced fingertip force calculation pipeline that maps fluid simulation outputs to tactile feedback.
  3. A validated ShakeSense prototype that outperforms conventional CoM rendering in user studies.
• Procedure and key techniques:
  • Use of Position-Based Fluid (PBF) simulation to compute fluid-container interactions.
  • Conversion of fluid-induced wrenches into fingertip forces using a dynamic force distribution algorithm.
  • Electrotactile stimulation via a high-density electrode array to render friction and pressure sensations.
  • Integration of VCoP to represent force magnitude and direction, modulated in real time based on fluid dynamics.

Results

• Concrete findings:
  • ShakeSense achieved an average user perception accuracy of 74.26% for distinguishing VCoP motion amplitudes.
  • Horizontal and vertical force correlations with measured data were strong (r > 0.7) for primary motion axes.
  • ShakeSense outperformed CoM rendering in subjective fidelity ratings across all fluid viscosities and actions.
• Advantage over baselines:
  • ShakeSense provided more realistic and multidimensional tactile feedback compared to CoM rendering, particularly for sloshing and swirling motions.
  • Electrotactile feedback enabled lightweight, low-latency interaction, unlike bulky mechanical systems.
• Experiments / evaluation:
  • Study 1: Evaluated VCoP perception across motion directions, amplitudes, and container masses. Participants synchronized hand movements with electrotactile feedback, achieving high discrimination accuracy.
  • Study 2: Compared ShakeSense with CoM rendering for fluid interactions (shaking, swirling, pouring) with virtual water and honey. ShakeSense consistently received higher fidelity ratings.
  • Metrics: Accuracy, RMSE, Pearson correlation, subjective Likert-scale ratings.
• Limitations and future work:
  • Current system focuses on precision grips, limiting applicability to power grips.
  • Electrotactile resolution is discrete, with only four reliable directional levels.
  • Rigid-body interactions and absolute pressure accuracy are not fully supported.
  • Future work includes improving wearability, expanding electrode density, and refining grasp models.

Summary

ShakeSense introduces a novel electrotactile system for simulating fluid dynamics in virtual environments, leveraging a Virtual Center of Pressure and fingertip force calculation pipeline. User studies demonstrate that ShakeSense provides realistic, multidirectional tactile feedback, outperforming conventional CoM rendering methods. The system is lightweight, responsive, and applicable to diverse VR scenarios, such as gaming, training, and scientific visualization. Future enhancements aim to improve resolution, wearability, and support for more complex interactions.