A Qualitative Investigation of User Transitions and Frictions in Cross-Reality Applications

Research Background and Issues

• What problems or challenges did the authors identify?

  • Although Augmented Reality (AR) and Virtual Reality (VR) are often studied independently, their practical applications frequently require integration to leverage their respective strengths. However, users may encounter significant friction and obstacles during transitions between these realities, including spatial disorientation, inconsistencies between realities, and physical and cognitive burdens.
  • Current research has rarely delved deeply into the friction and issues users experience during cross-reality (CR) transitions, which are critical for designing effective cross-reality systems.

• Why is this issue important?

  • In many practical scenarios (e.g., design, education, collaboration), users need to transition smoothly between multiple realities to enhance productivity. Significant friction during these transitions can negatively impact user efficiency and experience, thereby limiting the widespread adoption of cross-reality technologies.

• Research motivation and related work:

  • The study aims to explore friction points and solutions in cross-reality transitions by designing a cross-reality system and analyzing how users transition between different realities. By constructing Spatial Mental Models (SMM), the authors seek to systematically explain user behavior during cross-reality transitions.
  • Existing literature (e.g., studies on transition interface design) provides a foundation for cross-device and cross-reality interaction but lacks an in-depth understanding of single-user multi-reality transitions.

Solutions

• What methods or solutions did the authors propose?

  • The authors designed a cross-reality system integrating PC, AR, and VR, with a task requiring users to create a city sculpture model and frequently transition between the three realities.
  • Using the "think-aloud" method and semi-structured interviews, the study observed how participants transitioned between these modules and recorded their perceptions of transition friction.

• What is innovative about this solution?

  • The study proposed various models and classifications of user transitions (e.g., rapid transitions, gradual transitions) and summarized methods users employ to establish connections and gather information across realities.
  • It emphasized the importance of Spatial Mental Models (SMM) in cross-reality transitions and their role in user behavior, providing valuable insights for future cross-reality system design.

• What are the implementation steps? What key technologies were used?

  1. Task Design: Created a 3D modeling task that induced frequent transitions between realities.
  2. Experimental Setup: Used a Varjo-XR3 head-mounted display supporting seamless AR and VR switching, with models distributed across physical and virtual city environments.
  3. Data Collection and Analysis:
     • Recorded participants' verbal actions and interview responses to analyze their behaviors and cognition.
     • Employed a hybrid thematic analysis approach (combining inductive and deductive methods) to code transcripts and uncover psychological patterns and issues during transitions.

Research Findings

• What specific findings were achieved?

  • Identified three major friction points: spatial disorientation, fear of uncertainty, and physical and cognitive strain.
  • Proposed five user transition classifications (e.g., gradual transitions, rapid transitions) and validated how users utilize Spatial Mental Models (SMM) to address transition friction.
  • Suggested designs such as "Windows Between Realities" and "Anchor Points" to strengthen connections between different realities and reduce friction.

• What advantages does this solution have compared to existing ones?

  • Provided a systematic explanation of Spatial Mental Models (SMM) and their deep connection to friction issues in cross-reality transitions.
  • Offered clear design recommendations, such as introducing gradual transitions or using anchor points to reduce spatial disorientation and cognitive load.

• What were the experimental or evaluation results?

  • The experiment found that users demonstrated higher transition efficiency and confidence as they became familiar with the system. Additionally, as users refined their application of Spatial Mental Models, they were better able to plan and execute tasks.
  • Participants reported notable pain points (e.g., uncertainty during transitions and confusion caused by inconsistencies in computer models) but also provided positive feedback on system features that supported their transitions.

• Limitations and future directions:

  • Limitations:
    • The experimental design deliberately separated functions across different realities to provoke more transitions, which may not reflect real-world cross-reality systems.
    • Participants were primarily from the same technical university, which might limit the generalizability of the findings.
  • Future directions:
    1. Investigate more optimized cross-reality interface designs and explore user behavior in streamlined transition systems.
    2. Further study the ideal forms and applications of "anchor points" in multi-reality designs to enhance users' spatial cognition.
    3. Use physiological measurements to verify whether new transition mechanisms improve user experience.

Through this research, the paper provides an important theoretical foundation and practical recommendations for understanding and designing cross-reality technologies.