Toward Patient-Centered AI Fact Labels: Leveraging Extrinsic Trust Cues
Authors
AI technologies in healthcare hold great promise for addressing numerous challenges, but ensuring that patients understand, trust, and adopt these technologies remains a significant hurdle. While the HCI community has proposed AI documentation frameworks (e.g., model cards) to enhance understanding, patient perspectives in the healthcare AI documentation remain underexplored. To address this gap, we designed prototypes based on existing frameworks and gathered feedback from 18 participants to explore their perspectives on AI documentation in cardiology, a domain where high-stakes AI tools are increasingly used and understanding users' trust in AI is essential. Our findings revealed patient needs for more detailed information about healthcare AI technologies, the importance of extrinsic trust cues (e.g., regulatory status), and the integration of AI documentation into existing care processes. Based on these findings, we discuss two design implications: enhancing patient-centeredness in AI documentation and leveraging extrinsic trust cues to improve its design. This study contributes to the HCI community by amplifying the patient voice in designing AI documentation and offering actionable insights into leveraging extrinsic trust cues effectively.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 100%
Assertiveness-based Agent Communication for a Personalized Medicine on Medical Imaging Diagnosis: Assertiveness-based BreastScreening-AI
CHI '23· Explainable AI (XAI) +2
- 80%
Designing Theory-Driven User-Centric Explainable AI
CHI '19· Explainable AI (XAI) +1
- 80%
Designing AI for Trust and Collaboration in Time-Constrained Medical Decisions: A Sociotechnical Lens
CHI '21· Explainable AI (XAI) +1
- 80%
How Much Decision Power Should (A)I Have?: Investigating Patients’ Preferences Towards AI Autonomy in Healthcare Decision Making
CHI '24· AI-Assisted Decision-Making & Automation +1
- 80%
How Do Users Experience Traceability of AI Systems? Examining Subjective Information Processing Awareness in Automated Insulin Delivery (AID) Systems
IUI '24· Explainable AI (XAI) +1
- 67%
Fairness and Decision-making in Collaborative Shift Scheduling Systems
CHI '20· AI-Assisted Decision-Making & Automation +2
- 67%
Exploring and Promoting Diagnostic Transparency and Explainability in Online Symptom Checkers
CHI '21· Explainable AI (XAI) +1
- 67%
Patient Perspectives on AI-Driven Predictions of Schizophrenia Relapses: Understanding Concerns and Opportunities for Self-Care and Treatment
CHI '24· AI-Assisted Decision-Making & Automation +2
- 63%
User Compliance and Awareness towards Persuasive XAI: Investigating the Rhetorical Layer of LLM-generated Explanations
IUI '26· Explainable AI (XAI) +3
- 60%
Ignore, Trust, or Negotiate: Understanding Clinician Acceptance of AI-Based Treatment Recommendations in Health Care
CHI '23· Explainable AI (XAI) +1
Based on Jaccard similarity of research subtopics & professions (≥60%)