The Triangle of Misunderstanding in Interactive Virtual Narratives: Gulfs Between System, Designers and Players

Research Background and Issues

• What problems or challenges did the authors identify?
  Despite the powerful immersion and realistic interactivity of Virtual Reality (VR), there is often a communication mismatch between the designer's intent and the player's experience. This "miscommunication triangle" primarily manifests in the interactions among the designer, the system, and the player, potentially leading to narrative intentions being overlooked or misunderstood.

• Why is this issue important?
  Communication inconsistencies between designers and players directly impact the immersion and entertainment value of VR narrative experiences and may even lead researchers to misinterpret user experiences. This is particularly critical for VR applications in education, rehabilitation training, and professional training, where precise user behavior is essential.

• Research Motivation and Related Work
  Previous HCI literature has explored communication issues between users and systems in traditional 2D media, such as Don Norman's seven stages of action model and semantic engineering. However, these models fail to account for the unique bodily interactions, free exploration, and complexity inherent to VR. Therefore, the authors propose a communication model specifically tailored to VR to address these research gaps.

Solutions

• What methods or solutions did the authors propose?
  Based on Don Norman's model, the authors proposed a new model comprising eight categories of communication barriers, focusing on observing and recording communication issues in VR narrative design through structured interviews. These barriers are categorized into design-system, system-player, and narrative interpretation levels.

• What is innovative about this solution?

  1. Model Innovation: Extends Norman's seven stages of action model by integrating the designer-system-player triadic interaction into the framework.
  2. New Methodology: Identifies eight categories of communication barriers through structured interviews.
  3. Experimental Validation: Systematically classifies communication issues and analyzes their impact on narrative interpretation.

• What are the implementation steps and key technologies used?

  1. Model Development: Defines eight categories of communication issues, including: design limitations, design problems, evaluation perception issues, evaluation understanding issues, task understanding issues, situational understanding issues, environmental understanding issues, and execution issues.
  2. Experimental Design: Ten participants alternated as designers and players, first designing VR scenarios, then testing scenarios designed by others, and finally watching test recordings and engaging in discussions. Scenario tasks were created using the GUsT-3D toolkit.
  3. Data Collection: Detailed documentation of issues at each stage of design and use through a structured questionnaire framework.
  4. Issue Classification and Analysis: Categorized 127 issues, studied correlations between different issues, and analyzed their impact on narrative understanding.

Research Findings

• What specific results were achieved?

  1. Model Validation: Successfully applied the model to classify 127 communication issues, covering both designer and player perspectives.
  2. Issue Statistics: Design issues were the most common (30 instances), followed by performance issues (23 instances).
  3. Correlation Findings: Identified a significant correlation (0.6) between design issues and narrative understanding, as well as a notable association (0.5) between environmental understanding issues and performance issues.

• What advantages does it have compared to existing solutions?

  1. VR-Specific Model: Addresses the inability of traditional HCI models to explain the unique user experiences of VR.
  2. Systematic Analysis: Quantifies and categorizes issues, revealing their causes and potential cumulative effects.
  3. Practical Guidance: Offers actionable strategies to reduce misunderstandings, such as adjusting designs, adding guidance, or renaming UI elements.

• What were the experimental or evaluation results?

  1. Design Issues Significantly Impact Narrative Understanding: Poorly designed scenarios were more likely to cause player misunderstanding or incorrect narrative interpretation.
  2. VR Experience Reduces Communication Issues: Scenarios designed by experienced VR users exhibited fewer issues compared to those designed by inexperienced users.
  3. Cumulative Effects: Scenarios with more design issues were more likely to lead to performance issues on the player side.

• Limitations and Future Directions

  1. Limitations:
     • Small sample size, limited to 10 participants.
     • Lack of analysis on player behaviors deviating from design intentions (e.g., free choice or exploration).
     • Data primarily focused on the alignment between designer intent and player interpretation, with limited exploration of interaction representations.
  2. Future Directions:
     • Enhance the model to support iterative design processes and player free exploration behaviors.
     • Incorporate behavioral log data (e.g., eye tracking, motion trajectories) for deeper analysis of complex interactions.
     • Extend the model's applicability to other non-VR interaction technologies.

This study proposes a systematic VR designer-player interaction model and validates its effectiveness through experimentation. Its findings not only provide practical recommendations for optimizing VR narrative experiences but also offer researchers a theoretical framework for analyzing designer-player-system communication.