BioHaptics: Emotion Modulation via Biosignal-Inspired Ultrasonic Mid-air Haptics in Video-Watching Experiences

Paper Title

BioHaptics: Emotion Modulation via Biosignal-Inspired Ultrasonic Mid-air Haptics in Video-Watching Experiences

Publication Info

• Topic area: Emotion modulation through biosignal-driven ultrasonic mid-air haptics in multimedia experiences.
• Keywords: Ultrasonic mid-air haptics, BioHaptics, emotion modulation, biosignal features, video-watching, heart rate, respiration amplitude, heart rate variability, affective computing, multisensory feedback.

Background and Problem

• Problem / challenge: Existing ultrasonic mid-air haptics (UMH) designs rely on handcrafted, subjective tuning, leading to inconsistent and non-reproducible effects. The impact of biosignal-inspired haptics (BioHaptics) on emotions during video-watching remains unclear.
• Significance: Understanding how BioHaptics modulates emotions can enhance video-watching experiences, making them more immersive, engaging, and emotionally impactful. This has applications in entertainment, therapy, education, and stress management.
• Motivation and related work: Prior studies have shown UMH can influence affective responses, but they lack systematic exploration of biosignal-driven designs. Biosignals like heart rate (HR), heart rate variability (HRV), and respiration amplitude (RA) are known to correlate with emotions but have not been fully leveraged in UMH for emotion modulation.

Solution

• Proposed approach: BioHaptics, a system that encodes biosignal features (HR, HRV, RA) into ultrasonic mid-air haptics to modulate emotions during video-watching.
• Novelty:
  1. Systematic evaluation of how different biosignal features influence affective responses when encoded into UMH.
  2. Experimental demonstration of BioHaptics’ effects on subjective and physiological measures compared to video-only controls.
  3. Insights into the relationships between biosignal features and emotion dimensions, offering design recommendations for emotion modulation.
• Procedure and key techniques:
  1. Experiment 1: Collected biosignals (HR, HRV, RA, etc.) and self-reported emotions from participants watching emotion-eliciting videos.
  2. Experiment 2: Used biosignal features from Experiment 1 to create BioHaptic stimuli and evaluated their impact on new participants’ affective responses during video-watching.
  3. Statistical analysis of subjective ratings (valence, arousal, dominance) and physiological changes to assess the effectiveness of BioHaptics.

Results

• Concrete findings:
  • HR and RA haptics significantly increased respiration amplitude (RA) and heart rate variability (HRV), promoting emotion regulation and pleasantness.
  • HRV haptic significantly reduced heart rate (HR), leading to calmer emotional states.
  • All BioHaptics increased HRV across emotions, indicating improved emotion regulation.
• Advantage over baselines:
  • BioHaptics outperformed video-only controls in promoting physiological changes (e.g., increased HRV, RA) and enhancing emotional experiences.
  • Random haptic feedback (control condition) showed no significant effects, confirming the specific impact of biosignal-driven haptics.
• Experiments / evaluation:
  • Experiment 1: 22 participants watched six emotion-eliciting videos while their biosignals and self-reported emotions were recorded.
  • Experiment 2: 48 participants experienced videos with BioHaptic feedback (HR, HRV, RA) or random haptics, and their responses were compared to video-only controls.
  • Metrics: Valence, arousal, dominance ratings; HR, HRV, RA, respiration rate, skin conductance response.
• Limitations and future work:
  • Limited to six basic emotions; future work should explore more complex emotions.
  • Focused on specific biosignal features; additional features (e.g., EEG) could be tested.
  • Results need validation across other haptic modalities and diverse user demographics.

Summary

This study introduces BioHaptics, a system leveraging biosignal-inspired ultrasonic mid-air haptics to modulate emotions during video-watching. Experiments demonstrated that HR and RA haptics enhance pleasantness and emotion regulation, while HRV haptic induces calming effects by lowering HR. These findings highlight the potential of BioHaptics for creating immersive, non-invasive emotional experiences in multimedia contexts. Future research should explore broader applications, additional biosignal features, and generalization across different haptic devices and user populations.