FlowAR: How Different Augmented Reality Visualizations of Online Fitness Videos Support Flow for At-Home Yoga Exercises

Document Title

FlowAR: How Different Augmented Reality Visualizations of Online Fitness Videos Support Flow for At-Home Yoga Exercises

Document Information

• Topic Area: Augmented reality-based home yoga assistance systems
• Keywords: augmented reality, fitness videos, home workouts, yoga, human pose estimation

Research Background and Issues

• Identified Problems or Challenges:

  • Users watching fitness videos at home need to divert their attention to keep the screen within their line of sight, which disrupts motion flow and affects the proper execution of yoga poses.
  • Traditional solutions (e.g., dynamic screens or virtual reality coaches) require specialized motion capture systems or fixed screens, making them unsuitable for complex full-body movements and rotational yoga poses.

• Significance:

  • Yoga is a globally popular form of exercise that emphasizes smooth transitions between poses to promote physical coordination and balance. Therefore, providing solutions that support seamless movements in a home environment is crucial.

• Research Motivation and Related Work:

  • Previous studies have proposed various technical solutions for fitness training, including fixed screens, virtual reality coaches, and 3D pose animations. However, these approaches face challenges such as high costs, complex setups, and limited support for complex movements.
  • This study aims to leverage augmented reality technology to address these issues through dynamic video overlays.

Solution

• Method or Solution:

  • The FlowAR system is proposed, which uses head-mounted displays (HMDs) to present fitness videos as virtual overlay screens around the user, supporting various complex full-body yoga poses.
  • Three different screen layouts were studied:
    1. Circular Layout: Static surround layout with multiple screens distributed around the user.
    2. User-Anchored Layout: Virtual screens dynamically follow the user's head, ensuring the video remains within the line of sight.
    3. Trainer-Anchored Layout: Screens dynamically move based on the trainer's actions, guiding users to perform correct poses.

• Innovations:

  • Transforming existing online fitness videos into augmented reality overlays, avoiding the cost of creating professional 3D animations.
  • Overcoming the limitations of static displays to support multi-directional, seamless movement experiences.

• Implementation Steps:

  • Using Oculus Quest HMD for augmented reality display, combined with BlazePose 3D pose estimation algorithm to extract trainer motion data from ordinary videos.
  • Conducting user studies in experiments to validate the applicability of different screen layouts, analyzing movement differences and user feedback.

Research Outcomes

• Specific Results:

  • Designed and validated an augmented reality yoga teaching system, FlowAR, which enables dynamic screen displays using ordinary fitness videos in home environments.
  • Significant differences were observed in the effectiveness of different screen layouts in supporting seamless movements, particularly with dynamic screen layouts (User-Anchored and Trainer-Anchored) reducing interruptions caused by distractions.

• Advantages:

  • FlowAR eliminates the need for expensive motion capture equipment and utilizes ordinary video content, making home yoga training more economical and practical.
  • Dynamic layouts alleviate the inconvenience of fixed screens, significantly enhancing user experience and pose accuracy.

• Experimental or Evaluation Results:

  • The first experiment (in a laboratory setting) validated the superiority of dynamic layouts in reducing movement interruptions and improving user satisfaction.
  • The second experiment demonstrated FlowAR's practical applicability in home environments, with user preferences for screen layouts influenced by their yoga experience.
  • Novice users preferred the Trainer-Anchored layout for more guidance, while experienced users favored the User-Anchored layout for autonomous learning.

• Limitations and Future Directions:

  • Limitations:
    1. The HMD used is still relatively heavy, potentially affecting comfort during prolonged training sessions.
    2. The accuracy of the 3D pose estimation algorithm may decrease under poor lighting conditions.
    3. The system does not address key yoga training needs such as breathing guidance.
  • Future Directions:
    1. Introduce lighter display devices, such as smart glasses or contact lens displays.
    2. Add breathing guidance and real-time pose feedback features.
    3. Extend the system to other indoor sports training, such as Pilates and dance.
    4. Explore adaptive guidance systems that dynamically adjust screen layouts and assistance features based on user experience.

Conclusion

The FlowAR system successfully demonstrates the potential and practicality of augmented reality technology in home yoga training. It addresses the distraction issues of traditional screen-based training in an economical and practical way, providing a new method to enhance user motion flow and yoga teaching experiences. This study also offers design references and directions for future technology-driven sports teaching tools.