SonicHoop: Using Interactive Sonification to Support Aerial Hoop Practices

Document Title

SonicHoop: Using Interactive Sonification to Support Aerial Hoop Practices

Document Information

• Thematic Area: Application of HCI technologies in sports and arts, specifically using interactive sound feedback to support aerial hoop practice.
• Keywords: Interactive sonification, sound feedback, sound design, capacitive sensing, aerial acrobatics

Research Background and Issues

What problems or challenges did the authors identify?

1. Aerial hoop practice involves complex body coordination and techniques, but current training primarily relies on intrinsic bodily feedback, lacking enhanced external feedback.
2. Existing enhanced feedback strategies (e.g., visual and haptic augmentation) are difficult to implement in aerial hoop training due to factors such as equipment obstruction, the rotational nature of the hoop, and varying contact areas on the body.
3. While sound feedback (especially interactive sonification) has been applied in sports science, its role in vertical, full-body interaction remains underexplored.

Why is this issue important?

Aerial acrobatics not only demand high physical fitness but also require artistic expression. By enhancing feedback (particularly through sonification):

• The quality of movement can be improved, helping performers better master their techniques.
• New creative methods can be introduced, tightly integrating musical expression with bodily movement.
• Performers' perception and choreography processes can be influenced, inspiring creative artistic expression.

Research Motivation and Related Work

The authors were inspired by the following areas of work:

• Research on sports and HCI: including visual, haptic, and auditory augmentation for training.
• Applications of interactive sonification in sports: providing musical feedback to enhance performance.
• Interactive acoustic technologies in digital music and performing arts.

Solution

What methods or solutions did the authors propose?

The authors developed the "SonicHoop" system:

1. An augmented aerial hoop equipped with capacitive touch sensing to capture contact points on the hoop.
2. Implementation of interactive sonification to generate real-time sound feedback, transforming the hoop into a digital musical instrument.

What are the innovative aspects of this solution?

1. Novel application of interactive sonification: breaking away from traditional digital instruments designed solely for musical performance, achieving a high integration of body movement and sound feedback.
2. No additional equipment required: performers do not need to wear extra devices, enhancing natural interaction and offering greater freedom compared to traditional methods.
3. Three sonification strategies: providing different styles of sound feedback to explore the impact of sound on movement and creativity.

What are the implementation steps? What key technologies were used?

1. Hardware Design:
   • The outer hoop is covered with capacitive sensing electrodes to detect body contact points during movement.
   • Signals are transmitted to a computer, processed, and converted into sound feedback.
2. Software Design:
   • Max/MSP software is used to process sensor data and design sound.
   • Sound synthesis tools CataRT and Ableton Live are used to implement various sound feedback modalities.
3. Sonification Strategies:
   • Ambient Style: Dividing the hoop into four sections, each mapped to natural sounds.
   • Lounge Style: Based on musical segments, vertical spatial positions control transitions between musical sections.
   • Electro Dance Style: Position sensing layered with rhythmically intense electronic dance tracks.

Research Outcomes

What specific outcomes were achieved?

1. Provided a durable, cost-effective, and creative interactive performance platform.
2. Empirical studies demonstrated that regardless of the chosen sound strategy, audio feedback significantly improved movement quality.
3. Interactive sound feedback shifted performers' perception from "following music" to "creating music with their bodies," fostering entirely new creative approaches.

What advantages does it have compared to existing solutions?

1. Improved performance experience: Unique sound feedback enables practitioners to perceive movements more acutely, optimizing training processes.
2. Enhanced artistic creativity: Performers gain opportunities to explore new choreographic expressions, integrating sound feedback as part of the creative process.
3. High customization: The three sound styles cater to different use scenarios, from relaxed and fluid improvisation to dynamic performances.

What were the experimental or evaluation results?

1. Technical Evaluation: The total latency from touch to sound was 110 milliseconds, below the perceptible threshold, sufficient to support real-time interaction.
2. Observational Study: In-depth interviews with two professional performers validated the different impacts of sound strategies on their movements.
   • Ambient Sound: Inspired freestyle creativity, offering complete control over music generation.
   • Lounge Sound: Provided a sense of dance but could limit free expression.
   • Electro Dance Sound: Suited for dynamic performances, though the fast tempo could feel overwhelming.
3. Limitations: Some contact events were not detected, requiring further technical optimization.

Limitations and Future Directions

• Current user testing involved only two advanced performers; future studies should include participants with varying skill levels.
• Sound design adaptation needs further enrichment and optimization, such as enhancing real-time integration with the hoop's rotational characteristics.
• Technical improvements: Enhance the sensitivity of capacitive sensors to accommodate multi-layered clothing and implement real-time pattern recognition of data.
• Research opportunities: Extend SonicHoop to other aerial apparatuses, such as aerial silks, to explore more bodily interaction scenarios.