Design Explorations of Instruments and Interactions with Bidirectional Haptic Couplings

Paper Title

Design Explorations of Instruments and Interactions with Bidirectional Haptic Couplings

Publication Info

• Topic area: Bidirectional haptic interaction in digital musical instrument design.
• Keywords: Haptic feedback, digital musical instruments, bidirectional interaction, vibrotactile feedback, self-sensing actuators, physical-digital coupling, feedback instruments, tactile interaction, audio-rate signals, hybrid systems.

Background and Problem

• Problem / challenge: Most digital musical instruments (DMIs) rely on unidirectional control paradigms, where tactile input generates audio output without tactile feedback to the musician. Bidirectional interaction, which integrates sensing and actuation in the same modality and location, is rare and technically challenging, particularly at audio-rate frequencies.
• Significance: Introducing bidirectional tactile feedback can enhance the intimacy and expressiveness of DMIs, mimicking the reciprocal interaction found in acoustic instruments and enabling richer creative possibilities.
• Motivation and related work: Prior work on DMIs has explored unidirectional control and force feedback systems, but these often lack high-frequency bandwidth, impose modular separations, or require specialized tools. Vibrotactile feedback has been explored but typically avoids close coupling due to feedback instability. This paper addresses the gap by investigating the design implications of bidirectional tactile interaction using a novel system.

Solution

• Proposed approach: The HaptiCoupler system, a bidirectional voice coil transducer enabling simultaneous vibrotactile actuation and sensing at audio-rate frequencies.
• Novelty:
  1. Introduction of a self-sensing voice coil transducer for bidirectional tactile interaction.
  2. Integration of vibrotactile feedback and audio output, remutualizing the auditory and tactile domains.
  3. Exploration of creative design outcomes with experienced DMI designers.
  4. Demonstration of how system constraints (e.g., feedback, latency) can inspire creative uses.
• Procedure and key techniques:
  • The HaptiCoupler uses voltage for actuation and current for sensing, with feedback suppression via impedance modeling.
  • It supports three modalities: vibrotactile actuation, vibration sensing, and mechanical damping sensing.
  • A study was conducted with seven experienced DMI designers, who explored creative uses of the system over several weeks, producing diverse outcomes.

Results

• Concrete findings:
  • Participants produced three broad categories of outcomes: digital resonator instruments (DRIs), feedback instruments, and symbolic haptic interfaces.
  • The system latency (~35ms) and imperfect feedback cancellation were creatively exploited, e.g., for rhythmic interaction and self-oscillation techniques.
  • The damping parameter enabled intuitive mappings to synthesis parameters, enhancing interaction expressiveness.
• Advantage over baselines:
  • Unlike conventional unidirectional DMIs, the HaptiCoupler enables bidirectional tactile interaction, fostering richer and more nuanced creative outcomes.
  • The integration of audio and haptic signals creates a more cohesive and "alive" instrument experience.
• Experiments / evaluation:
  • Seven participants with 3–20 years of DMI design experience explored the system over three weeks.
  • Outcomes included extended physical interfaces, feedback-based instruments, and hybrid acoustic-digital systems.
  • Participants reported that the system shifted interaction from control to negotiation, aligning with the dynamic reciprocity of acoustic instruments.
• Limitations and future work:
  • High latency and imperfect feedback cancellation limited temporal bidirectionality.
  • The system struggled with high-frequency sensing and detecting low-amplitude vibrations.
  • Future work could focus on reducing latency, improving feedback cancellation, and exploring new actuator designs.

Summary

This paper introduces the HaptiCoupler, a bidirectional haptic system that enables simultaneous vibrotactile actuation and sensing at audio-rate frequencies. By integrating tactile feedback with audio output, the system remutualizes the auditory and haptic domains, fostering richer and more expressive interactions. A study with experienced DMI designers revealed diverse creative outcomes, including DRIs, feedback instruments, and hybrid systems, while highlighting how system constraints like latency and feedback instability can inspire novel techniques. The findings suggest that bidirectional tactile interaction shifts the musician's role from controller to negotiator, opening new possibilities for DMI design and performance.