Blended Whiteboard: Physicality and Reconfigurability in Remote Mixed Reality Collaboration

Document Title

Blended Whiteboard: Physicality and Reconfigurability in Remote Mixed Reality Collaboration

Document Information

• Subject Area: Mixed Reality (MR), Remote Collaboration, Human-Computer Interaction (HCI)
• Keywords: Mixed Reality, Virtual Whiteboard, Remote Collaboration, F-formations, 3C Collaboration Model, Intimacy Studies

Research Background and Problem

• Identified Issues or Challenges:

  • Traditional physical whiteboards require team members to share the same physical space. However, with the rise of remote work, teams increasingly rely on virtual whiteboards.
  • While virtual whiteboards offer flexibility with infinite canvases and adjustable perspectives, they lack the directness, natural communication, and collaborative physicality of traditional whiteboards.
  • Existing Mixed Reality (MR) solutions fail to effectively balance the tension between physicality and reconfigurability.

• Significance:

  • Whiteboards are crucial tools for collaborative work, and resolving the conflict between physicality and virtuality in remote work can enhance collaboration efficiency.

• Research Motivation and Related Work:

  • Existing studies either focus on enhancing physical interaction through MR or providing dynamically reconfigurable spaces through VR, with limited attention to the combined challenges of physicality and reconfigurability.
  • The authors aim to develop a new MR system that supports both physicality and reconfigurability to address the needs for task switching and spatial reconfiguration in remote collaboration.

Solution

• Proposed Method or Solution:

  • Designed and developed an MR system called "Blended Whiteboard," which supports flexible switching between different tasks in remote collaboration.
  • Proposed and implemented three core design principles for mixed reality whiteboard design:
    1. Dynamic F-formations: Enables flexible configurations and transitions between face-to-face and side-by-side setups.
    2. Dual-Mode Navigation: Supports both synchronized and independent navigation of the whiteboard.
    3. Reversible Transitions: Allows convenient return to physical configurations during reconfigurations.

• Innovations:

  • Combines the physicality of real whiteboards with the reconfigurability of virtual whiteboards, creating new work modes.
  • Provides theoretical and empirical support for addressing spatial reconfiguration challenges in remote collaboration.

• Implementation Steps and Key Technologies:

  • Developed a prototype system using Unity and integrated Oculus devices to support the MR experience.
  • Implemented features such as dynamic human avatars, panning and zooming of the virtual whiteboard canvas, and alignment with physical whiteboards.
  • Offered multiple input methods (e.g., gesture navigation and touch operations) and convenient environmental configurations.

Research Outcomes

• Specific Results:

  1. The system enabled an MR collaboration experience where users could work in front of a physical whiteboard while remote participants interacted via virtual avatars.
  2. Users in experiments expressed high appreciation for the system's combination of physicality and flexibility.
  3. Provided empirical analysis of the 3C collaboration model (Communication-Coordination-Cooperation), revealing user behavior patterns during collaboration mode transitions.

• Advantages Over Existing Solutions:

  • More flexible than traditional whiteboards and more natural than virtual whiteboards.
  • Supports different collaboration styles through dynamic transitions between face-to-face and side-by-side configurations.
  • Partially mitigates conflict scenarios such as avatar occlusion and synchronized canvas operation conflicts.

• Experiment or Evaluation Results:

  • User Study Findings:
    • Face-to-face configurations are more suitable for tasks requiring close collaboration, while side-by-side configurations are better for personal space management and initial discussions.
    • Virtual canvas navigation supports personalized work but occasionally causes unintended avatar interference.
    • Overall, the study highlighted the complementary relationship between physicality and reconfigurability across different tasks.
  • Survey results indicated user preference for systems that offer more personalized and shared views.

• Limitations and Future Directions:

  • Limitations:

    1. The design of user study tasks may favor specific collaboration scenarios (e.g., parallel tasks), limiting the generalizability to a broader range of tasks.
    2. The user experience of mode-switching mechanisms requires further improvement.
    3. Validation of the system's support for hybrid environments (e.g., co-located and remote user collaboration) and multi-user scenarios remains incomplete.

  • Future Directions:

    1. Explore how to scale the system to support more users and more diverse physical environments.
    2. Optimize MR collaboration experiences in hybrid scenarios (e.g., remote and local users).
    3. Investigate methods for implementing scalable multi-user group collaboration and interface optimization.