FretFlow: Adaptive Haptics for Rhythm and Articulation in Guitar Learning

Paper Title

FretFlow: Adaptive Haptics for Rhythm and Articulation in Guitar Learning

Publication Info

• Topic area: Haptic feedback systems for music education, focusing on rhythm and articulation in guitar learning.
• Keywords: Haptic feedback, guitar learning, rhythm training, articulation, embodied music cognition, adaptive systems, multimodal feedback, music education technology, wearable devices, vibrotactile feedback.

Background and Problem

• Problem / challenge: Existing guitar learning tools, such as metronomes and visual guidance systems, fail to adequately support the simultaneous learning of rhythm and articulation, which are critical for expressive guitar performance. Prior haptic systems focus on basic tempo maintenance or isolated motor corrections but neglect guitar-specific expressive techniques.
• Significance: Rhythm and articulation are essential for musicality and expressive control in guitar playing. Beginners struggle to coordinate timing and technique, particularly during complex transitions, which limits their ability to progress and perform expressively.
• Motivation and related work: While prior systems like Yousician and Rocksmith provide basic feedback on pitch and timing, they lack support for nuanced rhythm and articulation. Haptic feedback has shown promise in music learning, but existing systems are limited to generic beat cues or percussion instruments, leaving a gap in addressing guitar-specific needs.

Solution

• Proposed approach: FretFlow, a haptic vest-based system that provides real-time, adaptive, multimodal feedback for rhythm and articulation in guitar learning.
• Novelty:
  1. A structured design space mapping rhythmic and articulation patterns in guitar playing to distinct haptic patterns on a wearable vest.
  2. A workflow for authoring haptic scores with adaptive runtime intensity adjustments based on learner performance.
  3. Integration of real-time adaptive haptic feedback with visual and audio guidance in a unified interface.
  4. Empirical validation through iterative design and a two-week longitudinal study demonstrating improved rhythm and expressivity.
• Procedure and key techniques:
  • A wearable vest with 40 vibrotactile motors delivers spatially and temporally distinct haptic cues for beats, subdivisions, strumming directions, and accents.
  • An adaptive gain controller adjusts vibration intensity based on real-time performance metrics, such as timing deviations.
  • A score-centric interface synchronizes visual, audio, and haptic feedback, enabling learners to track progress and review errors.
  • A two-week crossover study compared FretFlow to traditional metronome-based practice, assessing timing accuracy, expressivity, and user experience.

Results

• Concrete findings:
  • FretFlow improved rhythm deviation by 19.42 ms, beat-alignment error by 12.01 ms, and inter-onset interval stability by 2.14 percentage points.
  • Pitch accuracy increased by 6.64 percentage points, and dynamic range improved by 0.94 dB.
  • Participants reported lower workload (NASA–TLX: −8.55 points) and higher flow (+1.39) and satisfaction (+2.87).
• Advantage over baselines:
  • FretFlow outperformed traditional metronome-based practice in timing accuracy, rhythmic stability, and expressive dynamics.
  • Complete novices showed the largest improvements, benefiting from the haptic cues as a temporal and expressive anchor.
• Experiments / evaluation:
  • A two-week within-subject crossover study with 20 participants (10 complete novices, 10 novice learners).
  • Objective metrics (timing, pitch, dynamics) and subjective measures (NASA–TLX, Flow, SUS) were collected.
  • Blind expert ratings confirmed improvements in rhythmic accuracy and musical expressivity.
• Limitations and future work:
  • The study did not isolate the contributions of individual system components or assess long-term retention.
  • Current sensing constraints limited quantitative analysis of articulation.
  • Future work will explore automated haptic score generation, support for advanced techniques (e.g., swing, syncopation), and comparisons with single-point haptic metronomes.

Summary

FretFlow is a haptic vest-based system designed to improve rhythm and articulation in guitar learning through real-time adaptive feedback. By mapping guitar-specific techniques to spatial haptic patterns and dynamically adjusting cue intensity, FretFlow bridges the gap between timing and expressive control. A two-week study demonstrated significant improvements in timing accuracy, rhythmic stability, and expressivity compared to traditional metronome-based practice. The system aligns with established teaching practices and offers a scalable solution for beginner guitarists. Future work aims to expand its capabilities and refine its integration into music education.