Designing Interactive Movement Sonification For Hip-Hop Dance

Paper Title

Designing Interactive Movement Sonification For Hip-Hop Dance

Publication Info

• Topic area: Interactive systems for movement sonification in hip-hop dance.
• Keywords: Hip-hop dance, movement sonification, improvisation, gesture recognition, embodied interaction, collective creativity, HCI, interactive performance, dance technology, participatory design.

Background and Problem

• Problem / challenge: Hip-hop dance, despite its global influence and improvisational nature, has been underexplored in HCI and interactive systems design. Existing systems often focus on contemporary dance and lack tools tailored to hip-hop’s unique requirements for improvisation, musicality, and collective dynamics.
• Significance: Hip-hop battles demand real-time improvisation and collective interaction, making them a rich domain for studying movement sonification. Designing systems for this context could enhance creative practices and provide new tools for dancers at various skill levels.
• Motivation and related work: Prior research in dance technology has focused on motion capture, interactive performances, and sound interaction, but few studies target hip-hop. Existing systems like Interactive Breaking Music System (IBMS) have explored sound control in breaking but lack a focus on broader hip-hop styles and collective dynamics. This paper addresses these gaps by designing a system specifically for hip-hop dance.

Solution

• Proposed approach: C-Battle, a smartphone-based system for interactive movement sonification, designed to support individual and collective improvisation in hip-hop dance through gesture recognition and sound mapping.
• Novelty:
  1. Formalization of a hip-hop movement vocabulary and design of interactive sonification scenarios.
  2. Empirical insights into how dancers experience sonification for exploration and improvisation.
  3. Guidelines for designing movement sonification systems in hip-hop contexts.
• Procedure and key techniques:
  • Autobiographical design leveraging the first author’s hip-hop expertise.
  • Formalization of foundational hip-hop movements (e.g., Wave, Rolls, Kickball Change, Tutting).
  • Development of five interaction scenarios (Discovery, Exploratory, Individual Creation, Audience Music, Team Creation).
  • Use of smartphones for motion capture and sound diffusion, employing explicit and implicit mapping strategies.
  • Workshops with novices, amateurs, and an expert dancer to evaluate the system.

Results

• Concrete findings:
  • Participants perceived sonification as both a validation of movements and a medium for creative exploration.
  • Novices benefited from simple mappings and rhythmic loops, while professionals sought more expressive and flexible tools.
  • Collective scenarios fostered collaboration and creativity, particularly in audience-driven sonification.
• Advantage over baselines:
  • Tailored to hip-hop’s improvisational and collective nature, unlike prior systems focused on contemporary dance or predefined choreography.
  • Enabled both individual and group interactions, supporting diverse skill levels and creative practices.
• Experiments / evaluation:
  • Three workshops with nine participants (novices, amateurs, and one expert).
  • Scenarios tested included individual and collective sonification, with data collected through videos, audio recordings, questionnaires, and interviews.
  • Reflexive thematic analysis identified themes of progressive understanding, sonification roles, and individual vs. collective interactions.
• Limitations and future work:
  • Limited participant sample and short-term workshops.
  • Need for longitudinal studies and real-world testing in battles or jams.
  • Technical improvements, such as alternative hardware and refined gesture recognition, are required.

Summary

This paper introduces C-Battle, a smartphone-based system for interactive movement sonification in hip-hop dance. By formalizing a hip-hop movement vocabulary and designing five interaction scenarios, the system supports both individual and collective improvisation. Workshops with participants of varying skill levels revealed that sonification serves as both a validation tool and a creative medium, fostering exploration and collaboration. The study provides design guidelines for tailoring sonification systems to hip-hop contexts, emphasizing adaptability to skill levels, constructive constraints, and action-perception loops. While limited in scope, this work opens new avenues for integrating technology into hip-hop practices and performance settings.