Cognition-oriented Facilitation and Guidelines for Collaborative Problem-solving online and face-to-face: An in-depth examination of format and facilitation influence on problem-solving performance

Document Title

Cognitive-Oriented Collaborative Problem Solving: A Study on Guidelines for Online and Face-to-Face Discussions and Their Facilitation Effects

Document Information

• Subject Area: Human-Computer Interaction (HCI), Computer-Supported Cooperative Work (CSCW), Complex Problem Solving and Meeting Technologies
• Keywords: Complex problem solving, meeting facilitation, face-to-face meetings, remote collaboration, cognitive-oriented guidelines

Research Background and Issues

• Identified Problems or Challenges:
  With the widespread adoption of remote work following the COVID-19 pandemic, many collaborative problem-solving tasks have shifted from face-to-face to online settings. However, existing remote meeting facilitation guidelines are often focused on macro-level procedural recommendations, with little attention paid to micro-level cognitive issues, such as real-time intervention, diagnosis, and content facilitation.

  Furthermore, the performance differences between online and face-to-face discussions in solving complex problems remain unclear, even though complex problem solving is a core component of many professional activities. This ambiguity hinders the development of optimized system designs and facilitation strategies.

• Significance of the Research:
  Complex problem solving requires higher-order cognitive processes, yet current online collaboration still faces technical limitations (e.g., lack of non-verbal communication, technical disruptions) and behavioral challenges (e.g., fewer turn-taking interactions). Investigating their impact on problem-solving performance will provide critical insights for designing cognitive-oriented collaborative systems.

• Research Motivation:
  The authors propose designing facilitation guidelines from three perspectives—cognition, social interaction, and digital platforms—to explore:

  1. Are there performance differences in complex problem solving between online and face-to-face formats?
  2. Can facilitation strategies improve problem-solving performance in different formats?

Solution

• Research Methods:
  The authors designed facilitation guidelines for complex problem solving based on a "cognitive-oriented" approach to enhance the effectiveness of collaborative discussions. The study employed a simulated problem-solving scenario (a coffee shop operation simulator) to explore the effectiveness of facilitation measures in a realistic problem context.

• Innovative Contributions of the Research:

  1. Proposed systematic, cognitive-oriented facilitation guidelines that incorporate cognitive processes such as information gathering, problem representation, solution generation, and goal evaluation into the discussion framework.
  2. Introduced the "Cognitive Three-Space Framework" (cognitive, social, digital) to address intervention scenarios across cognition, social interaction, and digital platforms, precisely capturing the multi-layered interaction needs in complex problems.
  3. Used a 2×2 factorial design to compare online versus face-to-face discussions and the presence versus absence of facilitation measures, comprehensively evaluating the specific effects on problem-solving performance.

• Implementation Steps and Techniques:

  1. Experimental Design: The authors recruited 80 participants, divided into 40 groups, and randomly assigned them to online and face-to-face facilitation/non-facilitation groups. Each task lasted 1.5–2 hours.
  2. Facilitation Guidelines: Provided cognitive-process-based prompts (e.g., "record hypotheses," "verify the correctness of hypotheses") and utilized online tools (Google Sheets, digital whiteboards, etc.) to encourage participants to share information and represent problems.
  3. Evaluation Metrics: Quantitatively assessed discussion effectiveness using three metrics—goal achievement (balancing indicators), overall performance scores (multi-level optimization), and participant satisfaction.

Research Findings

• Specific Findings:

  1. Without facilitation, there was no significant difference in goal achievement between online and face-to-face discussions. However, in evaluating multiple factors, online discussions performed significantly worse than face-to-face discussions.
  2. Overall, facilitation measures had a significant positive impact on goal achievement but limited effects on multi-factor balancing (overall performance scores). Additionally, facilitation methods were more effective in online settings, while in face-to-face discussions, they might cause greater interference effects.
  3. Proposed design directions for applying complex problem-solving guidelines in computer-supported cooperative work (CSCW) systems, including standardized analysis and interaction tools.

• Comparison with Existing Research and Advantages:

  1. Addressed the shortcomings of existing macro-level guidelines that fail to cover cognitive details.
  2. Expanded quantitative understanding of the impact of different collaboration formats on complex problem-solving performance.
  3. Advocated integrating cognitive-oriented systems into collaboration technology design to fundamentally enhance user experience and decision-making efficiency.

• Experimental and Evaluation Results:

  • With facilitation, the goal achievement capability of online discussions approached that of face-to-face discussions, but more cognitive and social support is still needed.
  • Participants rated the quality of facilitation at 4.33 out of 5, particularly appreciating its assistance in hypothesis representation and rational decision-making.

• Limitations and Future Directions:

  1. The current experiment employed a single facilitation style (conducted by one researcher); future studies could explore the effects of different facilitation styles on discussion outcomes.
  2. In-depth analysis of facilitation effects was limited by resources; future research could incorporate more sequential analyses to examine the immediate effects of interventions.
  3. Using standardized satisfaction scales could improve the cross-study comparability of evaluation metrics.

Conclusion

This study represents a breakthrough in the field of complex problem-solving facilitation by analyzing performance differences between online and face-to-face collaboration through a systematic cognitive-oriented framework and designing cognitive-based facilitation guidelines. Future directions include optimizing the cognitive support functions of CSCW systems and further exploring methods to enhance collaboration efficiency in complex scenarios.