How a Clinical Decision Support System Changed the Diagnosis Process: Insights from an Experimental Mixed-Method Study in a Full-Scale Anesthesiology Simulation

Research Background and Issues

• What problems or challenges did the authors identify?
  Research on Clinical Decision Support Systems (CDSS) often focuses on the later stages of the decision-making process, such as treatment decisions, while neglecting earlier stages like information gathering and integration, hypothesis generation, and consideration of diagnostic options. This research limitation results in a lack of deep understanding of how CDSS actually alters the decision-making process and the advantages or disadvantages of these changes. Furthermore, the impact of CDSS in acute care settings, including its effects on collaborative decision-making under stress and time constraints, has not been adequately studied.

• Why is this issue important?
  Diagnostic errors are one of the primary factors leading to adverse outcomes in acute care. Designing tools to support the diagnostic process can not only improve diagnostic accuracy but also enhance team communication and structure, better addressing the decision-making demands in high-risk medical environments.

• Research Motivation and Related Work
  The authors aim to explore how CDSS affects early decision-making steps, such as information gathering and integration, and compare this with the status quo (without CDSS). Additionally, the study employs conversation analysis and high-fidelity simulation methods to quantitatively and qualitatively investigate the actual application of CDSS in teams, incorporating an understanding of changes in team communication and thought processes.

Solutions

• What methods or solutions did the authors propose?
  The authors designed and implemented high-fidelity anesthesia simulation experiments to compare how teams with and without CDSS make diagnostic decisions during operating room crises. The CDSS design includes real-time displays of relevant symptoms and visualization tools to support early information gathering, combined with on-demand voice or keyboard input functionality.

• What are the innovative aspects of this solution?

  • For the first time, detailed conversation analysis of CDSS application in acute care teams was conducted, providing insights that had not been deeply explored before.
  • The CDSS does not solely provide final decisions but supports the entire diagnostic process, including early information gathering and hypothesis generation.
  • The design emphasizes user experience by reducing cognitive load on individual team members and promoting collaboration.

• What are the implementation steps and key technologies used?
  The research team organized 14 anesthesia teams into two groups (using CDSS vs. not using CDSS) to participate in simulated crisis scenarios. Through video recordings and detailed annotations of the data, the team analyzed communication, structure, and decision-making processes. Quantitative methods included measuring diagnostic time and NASA-TLX workload assessments, while qualitative methods involved video and conversation analysis.

Research Outcomes

• What specific results were achieved?
  The authors found that CDSS significantly altered team structure, communication patterns, and the diagnostic process:

  1. Changes in Team Structure: Nurses in CDSS teams participated earlier and more actively in the decision-making process, showing higher role engagement compared to non-CDSS teams.
  2. Changes in Communication: Teams using CDSS exhibited more systematic and collaborative communication, with more transparent information exchange.
  3. Changes in the Diagnostic Process: CDSS encouraged teams to adopt a more detailed and analytical decision-making process, reducing diagnostic errors or cognitive biases.

• What advantages does it have compared to existing solutions?

  • CDSS improved the quality of team collaboration and communication, empowering nurses to play a more active role within the team.
  • CDSS helped reduce common cognitive biases, such as premature closure or confirmation bias, while its visualization design alleviated individual cognitive load.

• What were the experimental or evaluation results?

  1. Quantitative Results: Diagnostic times in CDSS teams were more consistent, with significantly reduced standard deviation, indicating more uniform decision-making efficiency. NASA-TLX assessments showed that nurses using CDSS experienced lower workload and frustration levels.
  2. Qualitative Results: CDSS teams demonstrated a tendency toward more analytical thinking, carefully evaluating different diagnostic options to avoid potential errors from intuitive decision-making.

• Limitations and Future Directions

  • Limitations: It remains unverified whether the empowerment of nurses by CDSS is applicable to other disciplines; the study was conducted in a simulated environment without clinical outcome measurements; the data only covered single events, without examining long-term usage effects.
  • Future Directions: Further research should explore how to simultaneously support both analytical and intuitive thinking, design CDSS models better suited to various clinical scenarios, and develop more comprehensive evaluation methods that include real patient outcomes.

Through this study, the authors not only enriched the understanding of CDSS's impact on decision-making but also provided valuable insights and recommendations for the future design and evaluation of CDSS. These findings hold significant value for improving diagnostic efficiency and team collaboration in acute medical environments.