Viewer2Explorer: Designing a Map Interface for Spatial Navigation in Linear 360 Museum Exhibition Video

Title of the Paper

Viewer2Explorer: Designing a Map Interface for Spatial Navigation in Linear 360 Museum Exhibition Video

Paper Information

• Subject Area: Human-Computer Interaction (Human Factors Computing and Interaction Design)
• Keywords: 360 video, virtual exhibition, spatial exploration, map interface, video navigation, video interface design

Research Background and Problems

• Identified Problems or Challenges:

  • With the impact of the pandemic, numerous cultural institutions have developed online virtual exhibitions. However, current 360 video content is typically set on a linear timeline interface, limiting users' ability for autonomous exploration.
  • Compared to traditional panoramic virtual environments, 360 videos allow users to adjust their perspective but do not enable free control of direction and position, lacking in-depth interaction.
  • The current timeline-based navigation method fails to effectively provide spatial location information, making it difficult for users to comprehend the overall layout of the exhibition.

• Significance of the Problem:

  • Current virtual exhibitions rely on traditional video browsing methods, limiting user engagement and failing to fully leverage the immersive potential and educational value of virtual spaces.
  • Providing spatial navigation capabilities can enhance users' understanding of exhibition content and improve the user experience.

• Research Motivation and Related Work:

  • The authors, based on existing research, point out that the shortcomings of traditional timeline-based methods in spatial control call for new interface designs. In existing museum studies and virtual environment designs, map-based navigation solutions have shown potential but have not been fully implemented in 360° video spatial navigation.
  • Therefore, the authors aim to shift the museum video experience from mere "viewing" to "spatial experience" through a new interface.

Proposed Solution

• Proposed Method or Solution:

  • An enhanced interactive video interface based on maps—Viewer2Explorer—is proposed, combining traditional timeline functionality with spatial navigation capabilities, allowing users to actively explore and control the virtual exhibition space within 360 videos.
  • Viewer2Explorer integrates navigation through both time and space, enabling users to watch videos linearly via a timeline or jump to specific spatial locations by clicking on the map.

• Innovative Aspects of the Solution:

  • Introduced a novel transition from time-based to space-based navigation, adding spatial exploration functionality to traditional 360 video navigation.
  • Incorporated innovative map interface elements, such as color-coded paths (indicating different areas), position indicators, and virtual exhibition souvenirs (represented as "coins" for discoverable targets) to enhance users' spatial control capabilities.
  • Supported cross-path selection and interaction, making video streams not just follow preset paths but closer to customizable exploration experiences.

• Implementation Steps and Key Technologies:

  1. Used the Unity engine to create the Viewer2Explorer user interface, displaying maps, paths, and controls synchronized with video timelines.
  2. Recorded and edited 360 museum videos with multiple routes and designed corresponding operational features for the map interface.
  3. Developed keyboard and mouse-based interaction methods (e.g., play, pause, fast-forward, perspective control, route selection).
  4. Designed user experience experiments to evaluate the new interface's spatial perception, operability, and user satisfaction.

Research Outcomes

• Specific Outcomes:

  • Viewer2Explorer significantly improved users' spatial perception (e.g., sense of direction, self-orientation) and overall understanding of the exhibition space.
  • Compared to linear timeline interfaces, users demonstrated higher proactivity and reported enhanced motivation and exploratory behavior when using the map interface.
  • The study validated that the map interface helps users understand the distribution of exhibition content in virtual spaces and supports personalized museum tours.

• Advantages Compared to Existing Solutions:

  • Overcame the limitations of traditional timeline interfaces where users cannot change direction or position, enhancing navigation freedom.
  • Compared to other attempts (e.g., branching narratives offering path choices), Viewer2Explorer enabled users to create unique exploratory experiences, effectively promoting learning and immersion.

• Experimental or Evaluation Results:

  • Conducted user testing with 24 participants, comparing the "Timeline Interface (T condition)" with the "Timeline + Map Interface (T+M condition)".
  • Users in the T+M condition showed significantly better performance in spatial perception, autonomy, content understanding, and engagement compared to the T condition.
  • Experimental data indicated that users with the T+M interface were more proactive in using control features (e.g., fast-forward, pause) and rated their overall user experience higher.

• Limitations and Future Directions:

  • The video content was limited to cultural and art exhibitions; future research should expand to other domains (e.g., science exhibitions).
  • The video duration was relatively short (5 minutes); further testing is needed for longer videos or more complex map scenarios.
  • The study was primarily designed for desktop environments; further optimization and interface design for other media formats, such as VR devices, are needed.