SoniWeight Shoes: Investigating Effects and Personalization of a Wearable Sound Device for Altering Body Perception, Behavior and Emotion

Title of the Paper

SoniWeight Shoes: Investigating Effects and Personalization of a Wearable Sound Device for Altering Body Perception and Behavior

Paper Information

• Research Domain: Effects of multisensory feedback on body perception and behavior, particularly the application of auditory feedback technology in regulating health-related behaviors and perceptions
• Keywords: auditory body perception, multimodal interface, body sonification, emotion, interaction methods, evaluation methods, body interaction, wearable computing

Research Background and Issues

• Identified Problems or Challenges:

  • Body perception, including subjective perceptions of body size and shape, influences emotions and behaviors, but the potential of auditory feedback to alter body perception has not been fully explored.
  • Existing studies often focus on small sample groups or single population groups, making it difficult to assess the broader impact of sonification technology.
  • Multisensory technologies can alter body perception, but the individual factors (e.g., eating disorder symptoms, body focus, physical activity levels) that modulate these effects remain an important unresolved question.

• Significance:

  • Negative body perception is often associated with health issues such as eating disorders and physical inactivity. Understanding the mechanisms of these perceptual changes could drive the development of audiovisual assistive technologies.
  • Altering body perception may provide new intervention pathways for topics such as mental health, emotional regulation, and athletic performance.

• Research Motivation and Related Work:

  • Building on previous experimental studies on the relationship between footstep sounds and weight perception, this study expands the analysis to investigate how individual differences modulate the effects of sonification.
  • Comprehensive evaluation of the practical application of the "SoniWeight Shoes," including technological optimization and innovative experimental design.

Solution

• Research Methods:

  • Developed "SoniWeight Shoes," which alter the perception of body weight by adjusting the frequency distribution of footstep sounds.
  • Analyzed the effects based on participants' individual differences, such as levels of eating disorder symptoms (SED), physical activity levels (PA), body focus, and imaginative ability.

• Innovations:

  • Utilized an improved version of the device (digitalized and portable) and provided a high-quality experimental dataset to support the research.
  • Applied body maps to quantitatively assess the impact of sound feedback on changes in body perception, precisely locating responsive body regions.
  • Comprehensive experimental design incorporating behavioral, psychological, subjective, and physiological multidimensional data to obtain system results.

• Experimental Design and Implementation Steps:

  • Participants wore shoes equipped with footstep sound recording and playback functions to perform various walking tasks.
  • After each round of experiments, participants completed body map marking tasks, emotional assessment questionnaires, and body visualization tasks.
  • Multimodal sensors collected physiological data (e.g., ECG, skin conductance, EMG) and gait parameters.
  • Compared body perception changes under three sound conditions (high-frequency, low-frequency, natural control) and their relationships with individual factors.

Research Results

• Specific Findings:

  • High-frequency footstep sounds made participants feel lighter, more feminine, and happier; low-frequency sounds were associated with heavier, more masculine body perceptions.
  • Differences in sound perception significantly influenced body sensations (e.g., dominance, surprise), physiological responses (e.g., heart rate variability), and behavioral reactions (e.g., walking speed and gait dynamics).
  • Different groups (e.g., high SED/low SED, high IPAQ/low IPAQ) exhibited distinct psychological and physiological patterns in response to sound feedback changes.
  • Body maps revealed significant effects of high-frequency and low-frequency sound conditions on specific regions of the upper and lower body.

• Advantages Compared to Existing Solutions:

  • Optimized digital devices improved the stability and reproducibility of high-frequency and low-frequency filtering effects.
  • Expanded the scope of existing research through large sample group data analysis, revealing the influence of individual factors.
  • Achieved broad, multidimensional evaluation, providing comprehensive insights.

• Limitations and Future Directions:

  • Most participants were non-clinical samples, and further validation is needed to determine applicability to clinical populations.
  • Long-term effects and real-world applications remain to be studied, including the impact of sustained interventions on body perception, emotions, and behavior.
  • Potential technological improvements include introducing immersive stereo sound effects, upgrading wireless devices, and applying noise filtering algorithms.

Conclusion

This study reveals new pathways for individual perception modulation through innovative auditory feedback intervention technology, providing foundational support for advancements in body perception research and related HCI technologies. Through multimodal experimental design, quantitative tools, and open dataset contributions, the study demonstrates the potential value of personalized auditory feedback in enhancing health and emotional regulation. Future research could further explore clinical applications and long-term intervention effects.