Co-Designing Multimodal Tools for Radically Mobile Hybrid Meetings

Research Background and Issues

• What problems or challenges did the authors identify?
  This paper explores the challenges faced by remote participants in hybrid meetings who struggle to effectively engage in dynamic, informal, and mobile collaborative meetings. Traditional video conferencing technologies require fixed spatial configurations (e.g., meeting rooms and stationary screens), limiting the possibilities for ad hoc and flexible collaboration while excluding remote colleagues from informal interactions.

• Why is this issue important?
  With the widespread adoption of hybrid work models, collaboration in dynamic, flexible, and informal environments has become increasingly common. These highly mobile meeting formats are critical for fostering creativity and enhancing productivity. However, existing technologies fail to support mobile hybrid meetings, leading to feelings of exclusion and inequity among remote workers.

• Research Motivation and Related Work
  Previous research has primarily focused on hybrid setups in traditional fixed meeting rooms or mobile collaboration tools, with little attention paid to "mobile hybrid meetings." Considering the lack of remote participants' engagement in impromptu social interactions in hybrid work, the authors aim to explore ways to enhance collaboration between remote and co-located participants in dynamic, mobile environments.

Solution

• What methods or solutions did the authors propose?
  This study introduces the concept of "radically mobile hybrid meetings" and designs multimodal devices to break spatial constraints, enabling remote participants to naturally engage in dynamic, mobile collaborative environments.

• What are the innovative aspects of this solution?

  • Proposed a novel shift from traditional video-based communication to multimodal interaction, incorporating haptic, visual (light cues), and temperature feedback to compensate for the lack of visual cues.
  • Opened up a new design space for hybrid meetings, addressing the challenges posed by mobility in collaboration.
  • Developed technology solutions through user-centered approaches, including co-design and design fiction methods.

• What are the implementation steps and key technologies used?

  1. Exploration Phase: Conducted interviews with two companies to identify key barriers in hybrid collaboration.
  2. Co-Design: Held three co-design sessions where participants conceptualized and prototyped solutions to support mobile hybrid meetings.
  3. Design Fiction: Developed three design fictions based on co-design outcomes, such as the QCube device, the wearable Feedback Friend wristband, and others.
  4. Survey Evaluation: Collected user opinions and feedback on these fictional technologies through an online survey.

Research Findings

• What specific findings were achieved?

  1. Key Challenges Identified: These include turn-taking, conveying social cues, and directing conversation.
  2. Conceptual Tools Designed:
     • QCube: A multimodal cube device for transmitting social cues.
     • Feedback Friend: A wearable wristband for providing instant feedback between remote and co-located participants.
     • Buggie: A small mobile device enabling remote participants to initiate and engage in informal, mobile meetings.

• What advantages does it have compared to existing solutions?
  Unlike traditional hybrid meetings that rely primarily on video-based visual feedback, multimodal tools provide more flexible feedback mechanisms suitable for dynamic and non-stationary environments. Through haptic, temperature, and optical feedback, these tools offer low-bandwidth yet efficient interaction methods.

• What were the experimental or evaluation results?

  • Participants in co-design sessions generally agreed that haptic and visual feedback effectively addressed turn-taking and interruption issues.
  • Survey evaluations showed significant improvements in remote participants' perceived inclusion and interaction quality with co-located participants.
  • The study highlighted the potential value of multimodal feedback for ad hoc collaboration but also identified challenges related to device portability and social acceptance.

• Limitations and Future Directions

  • Limitations:
    • Fully functional prototypes for real-world scenarios have not yet been developed; the study relied on design fictions and user feedback.
    • Study participants were primarily from knowledge worker backgrounds, leaving other industry scenarios unexplored.
  • Future Directions:
    • Conduct prototype testing in real-world environments to validate feasibility and user experience.
    • Explore the potential of multimodal technologies across a broader range of industries and work scenarios.
    • Propose improvements to address social acceptance and privacy concerns related to these devices.

Conclusion

This study introduces and preliminarily defines the concept of "radically mobile hybrid meetings," demonstrating the feasibility of achieving this goal through co-design and multimodal technologies. The research opens a new design space for hybrid collaboration, emphasizing the need for lightweight, dynamic technological solutions. These tools can facilitate natural and seamless interactions between remote and co-located participants in highly mobile scenarios. Through this exploration, the authors provide valuable insights for creating more inclusive, flexible hybrid meetings that adapt to real-world work environments.