ErgoPulse: Electrifying Your Lower Body With Biomechanical Simulation-based Electrical Muscle Stimulation Haptic System in Virtual Reality

Document Title

ErgoPulse: A Biomechanics-Based Electrical Muscle Stimulation Haptic System for Electrifying Lower Limbs in Virtual Reality

Document Information

• Subject Area: Virtual Reality (VR), Haptic Feedback, Human Biomechanics, Electrical Muscle Stimulation (EMS)
• Keywords: Virtual Reality, Haptic Feedback, Electrical Muscle Stimulation, Biomechanical Simulation, Wearable Devices, Gaming Immersion, Large-Scale Motion Feedback

Research Background and Problem Statement

• Identified Problems and Challenges

  • Current research on VR haptic feedback devices primarily focuses on hand-based interactions, neglecting studies related to lower limb haptic feedback.
  • Existing haptic systems lack support for large-scale force feedback for lower limbs during virtual actions such as walking or kicking.
  • Traditional EMS-based haptic feedback systems face limitations, such as insufficient precision in force adjustment and a primary focus on upper limb movements.
  • Developing a haptic feedback system capable of simulating complex lower limb movements in realistic physical environments remains an unresolved challenge.

• Significance

  • Lower limbs play a critical role in real-life actions such as running, walking, and kicking. Simulating force feedback for these actions can significantly enhance immersion in virtual reality.
  • Improving the realism of haptic feedback contributes to enhancing the user experience in VR, further advancing its applications in gaming, education, rehabilitation, and other fields.

• Research Motivation and Related Work

  • To address the limitations of traditional haptic feedback systems in the domain of lower limbs, the authors propose increasing the precision of haptic feedback through biomechanical simulation.
  • By integrating existing haptic feedback research and EMS technology, the study aims to design a system capable of real-time computation and delivery of force feedback for lower limbs.

Solution

• Methodology and Solution

  • The ErgoPulse system is proposed, combining biomechanical simulation and EMS technology to provide real-time, large-scale motion force feedback for lower limbs in virtual reality.
  • The system consists of two components:
    1. Biomechanical Simulation: Integrates skeletal, joint, and motion models to compute the torque required for each joint in virtual scenarios in real time.
    2. EMS Feedback: Delivers personalized electrical stimulation intensity and location based on the simulated torque, achieving precise haptic feedback.

• Innovations

  • Real-Time Biomechanical Analysis: Utilizes open-source tools like OpenSim and Unity's Nvidia PhysX engine to calculate joint torques for lower limb movements in real time.
  • Personalized EMS Stimulation: Customizes electrical stimulation intensity based on user-specific parameters such as height, weight, and muscle characteristics, integrating these with biomechanical simulation results.
  • Diverse Application Scenarios: Supports continuous force feedback scenarios (e.g., water flow and air resistance in VR) and pulse force feedback scenarios (e.g., ball-kicking impacts).

• Implementation Steps and Techniques

  1. Use IMU and foot pressure sensors to collect user motion data.
  2. Perform biomechanical simulation to calculate target joint torques.
  3. Calibrate the EMS device for each user, adjusting intensity and location parameters.
  4. Transmit stimulation signals to the EMS device in real time to provide haptic feedback.

Research Outcomes

• Specific Results

  • The ErgoPulse system's haptic resolution and immersive experience were validated in two experiments:
    1. Experiment 1: Haptic Resolution Measurement
       • Users could distinguish force intensity changes of 5.91%-23.4% (depending on direction).
       • Users could discern average force direction changes of 15°-35°.
    2. Experiment 2: Experience Evaluation and Immersion
       • In VR gaming scenarios with continuous and pulse force feedback, ErgoPulse significantly improved force feedback accuracy compared to traditional EMS systems (with notable improvements in Jaccard similarity).
       • User surveys indicated that ErgoPulse significantly enhanced user experience, improving control responsiveness, sensory engagement, and environmental realism.

• Advantages

  • Provides real-time, precise, large-scale force feedback for complex lower limb movements, surpassing the limitations of traditional EMS systems.
  • Optimizes electrical stimulation intensity and location to reduce user discomfort and ensure consistency between force feedback and the virtual environment.
  • Enhances VR immersion, with potential applications in entertainment, rehabilitation training, and sports simulation.

• Experimental Results

  • Jaccard similarity analysis showed that ErgoPulse's force feedback closely matched target torque with significantly higher accuracy than traditional systems.
  • Witmer-Singer questionnaire results indicated significant improvements in VR immersion factors (control, sensory engagement, distraction resistance, realism).

• Limitations and Future Directions

  • Tingling sensations (muscle prickling) and skin stimulation require further improvement.
  • Pulse force environments may lead to less realistic foot haptic sensations.
  • Further research is needed to achieve higher precision in complex scenarios and reduce EMS setup time.

Future Work Suggestions

1. Expand Biomechanical Models: Enhance joint and muscle simulation capabilities and simulate more degrees of freedom.
2. Optimize Personalization Process: Use computational muscle models to reduce calibration time from one hour to a shorter duration.
3. Integrate Additional Haptic Feedback: Incorporate temperature stimulation, skin stretch devices, and foot impact simulators to achieve more realistic haptic effects.
4. Apply Magnetic Stimulation Technology: Minimize the tingling sensation of EMS and further optimize the user experience.

By proposing the ErgoPulse system, the authors demonstrated that combining electrical muscle stimulation and biomechanical simulation effectively addresses the limitations of traditional haptic systems in the lower limb domain, providing a pathway for simulating more realistic scenarios in the future.