"You'll Be Alice Adventuring in Wonderland!" Processes, Challenges, and Opportunities of Creating Animated Virtual Reality Stories

Research Background and Issues

• What problems or challenges did the authors identify?

  • Animated virtual reality (VR) storytelling combines computer animation and VR technology to provide audiences with immersive and emotionally resonant narrative experiences. However, there is a significant gap in knowledge and support in existing literature and tools regarding how to efficiently create such animated VR stories.
  • It is necessary to comprehensively understand the creation process and unique challenges of animated VR storytelling from the creators' perspective. These challenges include multi-element plots, narrative consistency (balancing story delivery with user autonomy), and difficulties in integrating interactive and audiovisual elements.

• Why is this issue important?

  • Animated VR stories are becoming mainstream in VR sections of film festivals (e.g., Cannes and Sundance) and are central to audience demand for immersive narrative experiences. Supporting creators in producing high-quality animated VR stories more efficiently is crucial for advancing VR technology applications in entertainment, education, and other fields.

• Research Motivation and Related Work

  • Current authoring tools are mostly limited to subset tasks (e.g., VR storyboarding or asset animation) and fail to cover the complete workflow.
  • Related human-computer interaction (HCI) research primarily focuses on general extended reality (XR) applications (e.g., training and rehabilitation), neglecting the unique aspects of animated VR storytelling, such as narrative engagement, emotional arousal, and character experience.
  • Animated VR stories face dual challenges of complexity and technical limitations when using narrative, audiovisual, and interactive techniques to tell stories, necessitating specialized exploration.

Solution

• What methods or solutions did the authors propose?

  • Conducted semi-structured interviews with 21 animated VR creators to extract 10 universal creation stages and 1 evaluation stage for animated VR storytelling.
  • Identified and summarized 9 unique challenges in creating animated VR stories (e.g., balancing narrative intent with audience autonomy, achieving satisfactory VR visual expression, coordinating multiple narrative perspectives).
  • Compared animated VR storytelling with general XR applications and proposed potential directions for future research to support this field.

• What is innovative about this solution?

  • Systematically outlined ten key creation stages, from idea generation to audience feedback, providing a clear framework for subsequent research and tool development.
  • Revealed unique challenges faced by animated VR story creators and conducted in-depth analysis of their root causes.
  • Proposed research opportunities based on interview data, covering experience design (e.g., emotional arousal, narrative autonomy) and technical support (e.g., parameter optimization, data visualization tools), laying the foundation for future studies.

• What are the implementation steps and key technologies used?

  1. Data Collection: The research team recruited and interviewed 21 creators with diverse professional backgrounds but shared experience in animated VR creation.
  2. Process Analysis:
     • Constructed workflow diagrams on whiteboards to map each creator's workflow.
     • Merged and decomposed semantically similar stages to form a unified ten-stage framework.
  3. Challenge Extraction:
     • Used thematic analysis to summarize common difficulties expressed by participants in key tasks.
  4. Result Validation:
     • Developed an online questionnaire to invite participants and additional creators to validate the uniqueness, importance, and completeness of the stages and challenges.

Research Outcomes

• What specific outcomes were achieved?

  • Creation Workflow:
    • Extracted 10 creation stages from "idea generation" to "audience feedback," including planning stages (e.g., story creation, pre-visualization, interaction design) and production stages (e.g., asset development, scene assembly, story integration).
    • Established two types of workflows: "story-driven" and "visual-driven," prioritizing narrative consistency and visual effects, respectively.
  • Creator Challenges:
    • Identified 9 unique challenges (17 specific issues), covering areas such as balancing narrative intent with audience autonomy, visual expressiveness, coordinating multiple narrative perspectives, and optimizing visual quality under performance constraints.
    • Additional challenges include inconvenient use of existing tools, lack of modules integrated with core story experiences, and incomplete data evaluation.

• How does it compare to existing solutions?

  • Provides a complete production workflow framework rather than focusing on partial or single tasks.
  • Innovatively explores new directions such as cross-perspective storytelling and emotional parameter adjustment based on creators' cognitive characteristics, filling gaps in existing XR and VR literature.
  • Emphasizes the importance of creativity, emotion, and audience experience in animated VR storytelling.

• What are the experimental or evaluation results?

  • During the validation phase, interviewed creators and additional creators (36 in total) widely recognized the comprehensiveness and accuracy of the workflow and summarized challenges.
  • Core challenges, such as "balancing narrative intent and autonomy" and "optimizing emotional impact," were deemed the most unique and urgent issues to address.

• Limitations and Future Directions

  • Limitations:
    • Interview samples primarily consisted of creators aged 22–33, lacking input from more experienced professionals in film or animation.
    • Limited focus on audio design, missing potential innovations in this area.
  • Future Directions:
    1. Explore mechanisms for deeply balancing narrative intent and audience autonomy in animated VR stories and develop related authoring tools.
    2. Design semantic description and reference-sharing systems for multi-element plots.
    3. Introduce dynamic visual optimization algorithms to enhance VR visual quality and performance balance.
    4. Develop tools for emotional and design parameter modeling to guide creators in emotional storytelling.
    5. Advance behavioral data collection and visualization technologies to help creators evaluate audience perception and refine narrative performance.

Conclusion

This study provides researchers and practitioners with extensive references and practical recommendations by comprehensively analyzing the creation process and challenges of animated VR storytelling. The systematic framework established by this research is expected to serve as a blueprint for tool development and theoretical construction in related fields.