WAVE: Anticipatory Movement Visualization for VR Dancing

Document Title

WAVE: Anticipatory Movement Visualization for VR Dancing

Document Information

• Subject Area: Dance visualization technology in Virtual Reality (VR) and Human-Computer Interaction
• Keywords: VR, dance guidance, dance games, motion visualization, interactive technology, motion immersion, body motion tracking, full-body movement, game technology, user research

Research Background and Problem

• Identified Problems and Challenges:

  • Dance games are a popular genre in virtual reality, but existing dance guidance methods often fail to comprehensively teach the nuances of dance movements or require users to pre-learn symbolic dance notations, which can be a barrier for non-professionals and beginners.
  • Teaching full-body dance movements in real-time without complex preparatory modes remains an unresolved challenge.

• Significance:

  • The combination of dance and VR offers multiple benefits, including health, social interaction, and performance, but effective improvisational dance guidance can make this activity more appealing, especially for users with no dance experience who simply want to enjoy themselves.

• Research Motivation and Related Work:

  • Previous studies and applications (e.g., Just Dance, Dance Central) often rely on symbolic motion instructions or provide limited abstract demonstrations, lacking real-time support for users to improvise and mimic.
  • There is a need for a visualization method that seamlessly conveys full-body dance movements, enabling users to engage in dance in real time without prior practice.

Solution

• Proposed Method/Solution:

  • The WAVE technique is introduced as an innovative anticipatory movement visualization method for dance. In this approach, users are guided into a scene featuring multiple rows of virtual dancers who perform choreographed movements with temporal offsets, allowing users to mimic the nearest dancer and predict the next step by observing the preceding movements of others.

• Innovative Features:

  • Utilizes a "wave-like" group dance format, transforming the temporal rhythm of choreography into a continuous digital visual cue.
  • Integrates the choreographic technique "canon" (choreographic relay) with real-time interactive mimicry, achieving dance guidance without symbolic abstraction.
  • Enables users to learn complex dance choreography in VR through full-body motion visualization without requiring a separate practice mode.

• Implementation Steps and Key Technologies:

  • The WAVE method introduces a virtual environment with three rows of virtual dancers positioned on the user's sides and front, using Oculus Quest 2 for full-body motion capture.
  • An 84-second modern dance choreography was recorded using the Xsens motion capture system.
  • Various virtual dancer arrangements were tested, with a "straight-line arrangement" selected as the final design to enhance observability and spatial perception.
  • User experiment data were collected by tracking the positions of users' heads and hands, quantifying the alignment between users' movements and the choreographed targets.

Research Results

• Specific Outcomes:

  • In a user study with N=36 participants, the WAVE method significantly outperformed traditional single-dancer baselines in terms of movement-following accuracy, including positional and directional alignment.
  • Users observed that WAVE made movement-following smoother, more natural, and more predictable.

• Advantages Comparison:

  • Compared to existing single-dancer demonstrations or symbolic methods, WAVE provides a real-time, uninterrupted learning experience, lowering the learning curve for new dance routines.
  • Improved users' success rates in mimicking movements promptly, with superior performance in faster-paced movements.

• Experimental Results:

  • WAVE reduced users' movement delays and even enabled some movements to occur ahead of the target timing, indicating improved accuracy in anticipating movement timing.
  • Multiple subjective surveys revealed that most users preferred the WAVE technique and found it more enjoyable and practical.

• Limitations and Future Directions:

  • The current design is only applicable to choreography primarily oriented forward and is not suitable for complex dance styles requiring frequent directional changes.
  • Further optimization may be needed for faster-paced dances.
  • The impact of WAVE on the learning curve of new users and its long-term appeal requires further investigation.
  • Future research should explore the application of WAVE in group social dance scenarios, such as supporting collaborative choreography in social virtual worlds.