Hapticus: Exploring the Effects of Haptic Feedback and its Customization on Motor Skill Learning: Tactile, Haptic, and Somatosensory Approaches

Research Background and Issues

• Identified Problems or Challenges: The authors highlight that existing haptic feedback devices have achieved positive outcomes in supporting motor skill learning, but it remains unclear how different types of haptic feedback influence learning performance and experience. Furthermore, no studies have explored the impact of customized haptic feedback on learning outcomes.
• Importance of the Issue: Motor skill learning is crucial for daily activities and professional skills (e.g., piano playing or surgical procedures). However, its complexity and the prolonged training required may lead to a loss of motivation among learners. Optimizing learning methods to enhance efficiency and motivation could significantly advance skill acquisition and retention.
• Research Motivation and Related Work: Although visual and auditory feedback are widely used in motor skill learning, they cannot convey critical elements such as force, coordination, or timing precision during operations. Haptic feedback (e.g., vibration tactile gloves, mechanical exoskeletons, and electrical stimulation devices) has been proven effective in enhancing fine motor skills. However, comprehensive comparisons of haptic feedback effects and studies on customized haptic feedback are still lacking.

Solution

• Proposed Solution: The authors designed a piano learning study using three haptic feedback devices (vibration tactile gloves, mechanical exoskeletons, and EMS electrical muscle stimulation devices) and allowed participants to customize the feedback sequence.
• Innovations:
  1. For the first time, comparing the performance of three haptic feedback devices in motor skill learning.
  2. Exploring the enhancement of learning outcomes and experiences through customized haptic feedback.
  3. Developing an integrated device combining different haptic feedback methods to support multimodal learning.
• Implementation Steps:
  1. Step 1: Participants completed predefined piano tasks using three different haptic feedback devices and evaluated the devices' performance and subjective experience.
  2. Step 2: Investigating the effects of customized haptic feedback by recording users' progress based on their preferences.
  3. Key technologies used: hardware construction of haptic feedback devices (EMS, motors, vibration sensors), behavioral experiment design, and statistical analysis.

Research Outcomes

• Specific Findings:
  1. The mechanical exoskeleton performed best in accuracy (notes) and had the highest user preference, but it was bulky and users felt a lack of control.
  2. EMS performed well in force control and timing precision, though some users reported discomfort or pain.
  3. Vibration tactile gloves excelled in comfort and user "autonomy" but were weaker in task performance.
  4. Customized haptic feedback significantly improved users' learning performance (note accuracy, duration, and force precision) and experience (autonomy).
• Advantages: Compared to single-device setups, multi-feedback mode customization can rapidly enhance skills, boost user motivation, and increase engagement.
• Experimental or Evaluation Results:
  • Users with customized haptic feedback showed significant improvements in note accuracy, duration, and force precision.
  • Customized learning enhanced users' sense of autonomy while reducing fatigue and task difficulty conflicts during learning.
• Limitations and Future Directions:
  1. Limitations:
     • Device weight affected long-term user comfort.
     • The study was limited to three haptic feedback devices and did not cover all possible haptic modalities.
  2. Future Directions:
     • Introduce more haptic feedback technologies, such as magnetic stimulation and spring-based mechanical devices.
     • Expand evaluation metrics to more complex skills, such as continuous note pressure control and dynamic transitions.
     • Develop machine learning-based personalized feedback adjustment mechanisms to optimize user performance.

Conclusion

This study proposes an innovative framework combining haptic feedback comparison and customized learning, offering significant design insights for motor skill learning, particularly piano learning. These findings not only contribute to understanding the strengths and weaknesses of haptic feedback but also provide a foundation for future haptic designers to develop more efficient and personalized learning systems.