Stories for I, They and You: Exploring In-situ Virtual Camera Setups for Live Streaming in Virtual Reality

Paper Title

Stories for I, They and You: Exploring In-situ Virtual Camera Setups for Live Streaming in Virtual Reality

Publication Info

• Topic area: Virtual camera usage in VR live streaming for enhancing viewer engagement.
• Keywords: VR streaming, virtual cameras, live streaming, immersion, camera setups, viewer engagement, media design, storytelling, spatial immersion, social immersion.

Background and Problem

• Problem / challenge: Virtual camera usage in VR streaming is underexplored compared to traditional media like cinema and animation. Streamers lack practical guidance on effectively using virtual cameras to enhance viewer engagement and storytelling.
• Significance: VR streaming is an emerging mass media format with unique potential for immersive and interactive viewer experiences, but its development is hindered by limited understanding of virtual camera practices.
• Motivation and related work: Previous research has explored VR streaming's technical challenges and creative potential but lacks systematic analysis of real-world virtual camera usage. This paper addresses this gap by investigating common practices and proposing actionable insights for streamers and developers.

Solution

• Proposed approach: A two-phase study combining video analysis of VR streamers and expert interviews to identify common camera usage patterns and derive design considerations.
• Novelty:
  1. Empirical analysis of 2,625 minutes of VR streaming video to identify common virtual camera usage scenarios.
  2. Expert-derived design considerations and implications for VR streamers and tool developers.
  3. Introduction of the Immersion Triangle framework to analyze and enhance immersion in VR streaming.
• Procedure and key techniques:
  1. Video analysis of Twitch streams from eight popular VR streamers, focusing on camera views, angles, frames, and setups.
  2. Expert interviews with 10 media professionals to gather feedback on camera techniques and explore VR streaming's potential.
  3. Synthesis of findings into design recommendations and the Immersion Triangle conceptual framework.

Results

• Concrete findings:
  • Identified three common camera views: first-person (immersive), second-person (intimate), and third-person (contextual).
  • Observed four camera frames: close-up, medium close-up, medium-long, and full-body.
  • Categorized camera setups into monologue, dialogue, and multilogue scenarios.
• Advantage over baselines:
  • Provides systematic insights into VR camera usage, bridging gaps between VR streaming and traditional media practices.
  • Offers actionable design recommendations to improve camera setups and viewer engagement.
• Experiments / evaluation:
  • Phase 1: Thematic analysis of 2,625 minutes of VR streaming videos from eight streamers.
  • Phase 2: Interviews with 10 media experts, each with 10+ years of experience, to validate findings and derive design implications.
• Limitations and future work:
  • Focused primarily on VRChat, potentially missing patterns from other VR platforms or genres.
  • Relied on video data without direct input from professional VR streamers.
  • Limited exploration of non-technical aspects like narrative techniques and workflows.
  • Future work could extend to other VR genres, involve professional streamers, and explore systems that enhance immersion and delegate streamer roles.

Summary

This paper investigates virtual camera usage in VR streaming through a two-phase study comprising video analysis and expert interviews. It identifies common camera views, frames, and setups, and proposes design considerations to enhance VR streaming practices. The Immersion Triangle framework is introduced to analyze narrative, spatial, and social immersion in VR streaming. The findings highlight VR streaming's potential as a novel mass media format and provide actionable insights for streamers and developers to improve viewer engagement and storytelling. Future research could explore broader VR genres, involve professional streamers, and develop systems to enhance immersion and interaction.