How Space is Told: Linking Trajectory, Narrative, and Intent in Augmented Reality Storytelling for Cultural Heritage Sites

Title of the Paper

How Space is Told: Linking Trajectory, Narrative, and Intent in Augmented Reality Storytelling for Cultural Heritage Sites

Paper Information

• Subject Area: Application of augmented reality technology, narrative and creation in cultural heritage contexts
• Keywords: Augmented Reality (AR), Mixed Reality (MR), storytelling, cultural heritage, creation tools, human-computer interaction

Research Background and Issues

• Problems and Challenges: The paper highlights that previous research has focused on the impact of augmented reality storytelling on end users (e.g., visitors) while neglecting the creators' intentions and creation processes. This bias has resulted in existing authoring tools failing to adequately consider spatial and narrative parameters, thus falling short of meeting creators' needs and expectations.
• Significance: By focusing on the creators' perspective, the study aims to further explore the potential of augmented reality as an innovative medium of expression, while creating more diverse and meaningful digital content for cultural heritage sites, thereby enhancing their cultural and social significance.
• Research Motivation and Related Work: The authors seek to balance spatial exploration and narrative expression in the storytelling creation process. By studying multiple cases, they aim to develop tools that support creators' intentions and explore the principles and patterns of augmented reality storytelling creation.

Solution

• Proposed Method:
  • Define a content format called "Spacetelling," which binds linear narratives to spatial trajectories.
  • Develop a high-fidelity augmented reality creation tool prototype, including a desktop authoring interface and a mobile AR presentation platform.
  • Design a five-step creation process and select three Korean cultural heritage sites as the background for creation tasks.
• Innovations:
  • Establish two creation modes: "narrative delivery" and "spatial exploration," and explore the relationships between creator intentions, spatial trajectories, narrative structures, and content functionalities.
  • Propose spatial and narrative models tailored to creators' needs and translate them into corresponding design recommendations.
• Key Technologies:
  • Utilize CesiumJS as the 3D map interface, combined with Open Street Map to provide relevant spatial information.
  • Metadata architecture supports geolocation tagging of multimedia data and content reconstruction.
  • Use virtual reality (VR) simulation to assist creators in understanding augmented reality application scenarios.

Research Outcomes

• Specific Results:
  • Based on creation tasks completed by 22 participants, the study summarized two augmented reality storytelling creation modes: narrative delivery (story-centered) and spatial exploration (space-centered).
  • Creation modes were significantly related to the spatial characteristics of the target cultural heritage sites: narrative delivery mode tended to use concentrated trajectories in limited spaces, while spatial exploration mode preferred extended trajectories covering the entire area.
  • Analyzed resource usage, spatial and temporal considerations, and multimedia data integration strategies during the creation process.
• Advantages:
  • Provides empirical data on augmented reality storytelling creation behaviors, uncovering creators' actual needs in augmented reality applications.
  • Proposes three key design recommendations to aid future development of tools that support creators' intentions and improve efficiency.
• Experiment and Evaluation Results:
  • Narrative delivery mode content often exhibited clear story arcs and strong narrative coherence (significant logical sequence).
  • Spatial exploration mode content featured broad thematic connections without significant logical sequence, but emphasized coverage in spatial trajectory design.
• Limitations and Future Directions:
  • Limited sample size, covering only three cultural heritage sites, may affect the generalizability of the findings.
  • The strict definition of linear narratives in the Spacetelling format somewhat limits interactivity and the potential for hypertext storytelling.
  • Future directions include developing more comprehensive creation tools, expanding the sample range, exploring nonlinear storytelling possibilities, and introducing dynamic interaction features.

Design Recommendations

1. Provide Templates and AR Resources Based on Creation Intent:

   • Recommend structural templates based on priority for spatial exploration or narrative delivery.
   • Offer categorized AR resources (e.g., spatial background enhancements and narrative character models).

2. Support Creators' Spatial and Temporal Awareness:

   • Provide planning tools to help creators set appropriate spatial distances and temporal rhythms.
   • Offer time estimation and optimal suggestions based on the experience environment.

3. Simulate User Experience in Virtual Reality:

   • Implement digital twin designs of target cultural heritage sites to showcase highly detailed spatial structures.
   • Use VR environments during the creation process to simulate real augmented reality experiences, assisting creators in optimizing content design.

References

The authors cite relevant key literature in augmented reality technology, narrative theory, and the cultural heritage domain, combining practical research to propose design recommendations and validate their theoretical framework. The references include numerous detailed examples of potential use cases and foundational theoretical backgrounds.