Muscle Synergies Learning with Electrical Muscle Stimulation for Playing the Piano

Title of the Paper

Muscle Synergies Learning with Electrical Muscle Stimulation for Playing the Piano

Paper Information

• Field of Study: Human-Computer Interaction, Electrical Muscle Stimulation, Music Education
• Keywords: Electrical Muscle Stimulation, Muscle Synergies, Thumb-Under Technique, Scales, Piano

Research Background and Problem

• Problem or Challenge: Beginners need to coordinate forearm and shoulder muscles to improve musical quality when playing piano scales. However, due to a lack of proper muscle synergy (e.g., using the thumb-under technique), they struggle to play notes evenly.
• Significance: Improving playing techniques is crucial for musical quality. Enhancing muscle coordination to help beginners quickly and efficiently master playing techniques could benefit music education and motor skill training.
• Motivation and Related Work:
  • Previous EMS (Electrical Muscle Stimulation) systems primarily assisted beginners in learning basic skills, such as finger movements and rhythm, through direct motion control. Further research is needed to support multi-body part coordination, i.e., muscle synergies.
  • Studies have shown that experts achieve advanced muscle synergies when playing piano scales, while beginners often fail to effectively utilize shoulder muscles to coordinate forearm movements.
  • This study aims to propose an EMS-based method to improve beginners' muscle synergies for playing scales evenly.

Solution

• Method or Solution: The authors propose an EMS-assisted system that applies electrical stimulation to the deltoid muscles of the shoulder, helping beginners master the "thumb-under technique" and play piano scales evenly without needing to learn complex muscle coordination.
• Innovations:
  • Combining EMS with Non-negative Matrix Factorization (NMF) to analyze muscle synergies, focusing on improving muscle coordination in musical performance.
  • The system targets specific muscles (shoulder deltoid) for stimulation, integrating it with active movement to balance learning outcomes and user experience.
• Implementation Steps and Key Technologies:
  • Thumb-Under Technique: Beginners slightly rotate their elbow to perform the thumb-under motion while coordinating the deltoid muscles of the shoulder with the flexor muscles of the forearm.
  • Non-negative Matrix Factorization (NMF): Analyzes muscle synergies in terms of spatial (muscle distribution) and temporal (muscle activation time series) dimensions.
  • EMS System Implementation: Includes an electronic piano, function generator, isolator, and electrical stimulation device; applies 200ms of electrical stimulation to the shoulder deltoid muscle when the E key of the scale is pressed.

Research Results

• Specific Findings:
  • Experimental results show that beginners practicing with the EMS system achieved greater uniformity in playing scales compared to the control group without EMS, particularly in the consistency of note velocity.
  • Spatial muscle synergy changed, with beginners starting to coordinate the deltoid muscles of the shoulder more effectively with the flexor and extensor muscles of the forearm.
• Advantages:
  • The EMS method significantly reduces the time required for beginners to learn muscle synergies and master basic playing techniques, improving musical performance quality.
  • Compared to traditional methods, EMS provides a non-invasive, lightweight, and precise training approach.
• Experimental or Evaluation Results:
  • User Study:
    • Participants were divided into an experimental group (practicing with EMS) and a control group (practicing without EMS). The experimental group showed significant reductions in scale uniformity metrics (standard deviation of velocity and duration) across various tempos, while the control group showed no significant changes.
    • Muscle synergy analysis revealed that the experimental group exhibited increased shoulder muscle weighting, with spatial synergy becoming closer to that of experts.
  • Quantitative Feedback:
    • The experimental group significantly outperformed the control group in improving velocity uniformity.
• Limitations and Future Directions:
  • Limitations: The study did not evaluate the long-term retention of learning effects; the small and skill-diverse participant sample might have affected statistical analysis results.
  • Future Directions:
    • Conduct long-term evaluations to analyze the retention of motor skill training effects with EMS.
    • Expand the participant pool to test the impact of skill differences on the effectiveness of the EMS system.

Conclusion

This study proposes an innovative EMS-based support system that improves beginners' shoulder and forearm muscle synergies, enabling them to play piano scales more evenly. Experimental results demonstrate that EMS significantly enhances beginners' playing quality and muscle coordination, suggesting its potential in music training and motor skill learning. This research lays the groundwork for further exploration of EMS applications in education and motor skill training fields.