SootheMind: Exploring Body-Site-Specific Vibrotactile and Thermatactile Stimuli for Music-guided Emotion Modulation

Paper Title

SootheMind: Exploring Body-Site-Specific Vibrotactile and Thermatactile Stimuli for Music-guided Emotion Modulation

Publication Info

• Topic area: Affective haptics for emotion modulation in music-guided scenarios.
• Keywords: Vibrotactile stimuli, thermatactile stimuli, emotion modulation, Valence-Arousal model, EEG, wearable haptics, body-site-specific haptics, multisensory integration, music synchronization, affective computing.

Background and Problem

• Problem / challenge: Existing affective haptic systems prioritize technical feasibility over understanding the optimal stimuli types and body sites for emotion modulation, particularly in music-guided contexts. There is limited research on the synergistic effects of vibrotactile and thermatactile stimuli across different body sites.
• Significance: Understanding how haptic modalities interact with music and body sites can guide the design of wearable devices for emotion regulation, enhancing mental well-being and user experience in applications like mindfulness, gaming, and driving.
• Motivation and related work: Prior studies have shown that vibrotactile cues enhance arousal and thermatactile cues improve valence, but these effects have been studied in isolation or with limited focus on body-site specificity. The interaction between haptic modalities and body sites under dynamic media like music remains underexplored.

Solution

• Proposed approach: Development of a music-synchronized haptic system delivering vibrotactile, thermatactile, and combined stimuli to the wrist, neck, and ear, evaluated using EEG and subjective ratings based on the Valence-Arousal model.
• Novelty:
  1. Systematic investigation of body-site-specific emotional effects of vibrotactile, thermatactile, and combined stimuli in music-guided scenarios.
  2. Dual-layered mapping strategy for real-time synchronization of haptic stimuli with music at micro-acoustic and macro-structural levels.
  3. Comprehensive evaluation of physiological (EEG) and psychological (subjective ratings) responses under relaxing and exciting music conditions.
  4. Design space for affective wearables linking body sites, stimulus types, and emotional outcomes.
• Procedure and key techniques:
  1. Developed vibrotactile and thermatactile systems: Vibrotactile stimuli synchronized with music rhythm using low-frequency audio analysis; thermatactile stimuli aligned with musical phases using pre-orchestrated thermal transitions.
  2. Conducted experiments with 16 participants, applying stimuli to wrist, neck, and ear under relaxing and exciting music conditions.
  3. Measured emotional responses using EEG-based arousal and valence indices and subjective Self-Assessment Manikin (SAM) ratings.

Results

• Concrete findings:
  • Vibrotactile stimuli enhanced arousal, particularly at the ear site, while thermatactile stimuli improved valence, especially at the wrist.
  • Combined stimuli provided a balanced, immersive experience, with context-dependent effects at the neck.
  • Under relaxing music, the ear showed the highest arousal (EEG: M = 0.540) but lower valence, while the wrist consistently yielded higher valence (EEG: M = 0.049).
  • Under exciting music, combined stimuli at the neck elicited the highest arousal (EEG: M = 0.488).
• Advantage over baselines:
  • All haptic conditions significantly outperformed the music-only baseline in both EEG and subjective measures.
  • Vibrotactile stimuli consistently boosted arousal, while thermatactile stimuli enhanced pleasantness compared to unimodal stimuli.
• Experiments / evaluation:
  • Participants experienced nine haptic conditions (3 body sites × 3 stimulus types) under two music contexts.
  • EEG and SAM ratings were analyzed using paired t-tests and two-way ANOVA.
• Limitations and future work:
  • Controlled lab setting limits generalizability to real-world contexts.
  • Small sample size (16 participants) with a narrow age range.
  • Future work should explore personalization, long-term effects, and diverse participant demographics.

Summary

This study systematically investigated the emotional effects of vibrotactile, thermatactile, and combined stimuli applied to the wrist, neck, and ear during music-guided scenarios. Vibrotactile stimuli enhanced arousal, thermatactile stimuli improved valence, and their combination provided a balanced experience. The ear was most effective for arousal, the neck showed context-dependent effects, and the wrist consistently enhanced pleasantness. These findings offer practical guidance for designing affective wearables tailored to specific emotional and contextual goals, with implications for mindfulness, gaming, and safety applications. Future research should address ecological validity, personalization, and broader demographic inclusion.