When Fingers Become Tools: Rendering Virtual Tool Inertia with a Finger-Mounted Extending Rod

Paper Title

When Fingers Become Tools: Rendering Virtual Tool Inertia with a Finger-Mounted Extending Rod

Publication Info

• Topic area: Virtual reality haptics and tool interaction
• Keywords: Finger-mounted device, rotational inertia, virtual tools, haptic feedback, VR immersion, tool embodiment, inertia tensor, dynamic touch, wearable haptics, user experience

Background and Problem

• Problem / challenge: Conventional handheld VR controllers are limited in reproducing diverse tool shapes, sizes, and inertial properties due to fixed form factors and mass distributions. Finger-based approaches offer flexibility but lack inertial feedback, creating a trade-off between device simplicity and physical realism.
• Significance: Accurate rendering of inertial properties in VR tools enhances immersion, realism, and enjoyment, addressing visuo-haptic conflicts that diminish presence during tool use.
• Motivation and related work: Prior research has explored shape-changing controllers and finger-based object rendering, focusing on mass distribution and visual redirection. However, these approaches either lack inertial sensations or are mechanically complex and heavy. This paper bridges the gap by combining finger-based flexibility with rotational inertia feedback.

Solution

• Proposed approach: Finger-Mounted Extending Rod (Finger Rod), a wearable device that modulates fingertip mass distribution using extendable metal rods to reproduce rotational inertia of virtual tools.
• Novelty:
  1. Combines finger-based expressivity with rotational inertia feedback for VR tool rendering.
  2. Matches finger poses to virtual tools using inertia tensor similarity.
  3. Demonstrates perceptual amplification of rotational inertia (4.19–10.45×) through finger-based interactions.
  4. Enhances immersion, realism, and enjoyment in VR scenarios by aligning tool inertia with finger-generated feedback.
• Procedure and key techniques:
  • Tool Embodiment Pipeline: Pose Priming, Pose Alignment, Spawn with Redirection and Actuation.
  • Hardware: Wrist-mounted control module and finger extension modules with linear actuators.
  • Software: Unity-based communication protocol and hand tracking via Meta Quest 3 SDK.
  • Studies: Evaluated embodiment, inertia-tensor similarity, perceived rotational inertia, and user experience in VR scenarios.

Results

• Concrete findings:
  • 10 finger poses maintained embodiment under visual redirection, achieving inertia tensor similarities of 0.936–0.991 with matched tools.
  • Perceived rotational inertia amplified by 4.19–10.45× compared to theoretical values.
  • Inertia-aligned VR tool interactions significantly improved immersion, realism, and enjoyment across six scenarios.
• Advantage over baselines:
  • Tool identification accuracy (52.9%) exceeded chance level (16.7%) and bare-hand condition (27.38%).
  • Inertia-aligned conditions consistently outperformed inertia-misaligned and no-device conditions in user experience metrics.
• Experiments / evaluation:
  • Study 1: Evaluated embodiment and inertia-tensor matching for finger poses and tools.
  • Study 2: Measured perceived tool length and rotational inertia using psychophysical staircase procedure.
  • Study 3: Assessed tool recognition and user experience in six VR scenarios (e.g., drumming, cooking, shooting).
• Limitations and future work:
  • Limited resolution in inertia-tensor differentiation between similar tools.
  • Absence of context-specific haptic cues (e.g., recoil forces, center-of-mass shifts).
  • Future work aims to expand haptic channels and modularize the device for broader applications.

Summary

The Finger-Mounted Extending Rod transforms fingers into virtual tools by modulating fingertip mass distribution to reproduce rotational inertia. Through three studies, the system demonstrated effective tool embodiment, amplified perceived inertia (4.19–10.45×), and enhanced user experience in VR scenarios. By combining finger-based expressivity with physical realism, this wearable device bridges the gap between lightweight finger interfaces and mechanically complex controllers. Future developments aim to incorporate additional haptic feedback modes, such as recoil and fluid resistance, to further enrich VR interactions.