Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda
Authors
Advances in artificial intelligence, sensors and big data management have far-reaching societal impacts. As these systems augment our everyday lives, it becomes increasing-ly important for people to understand them and remain in control. We investigate how HCI researchers can help to develop accountable systems by performing a literature analysis of 289 core papers on explanations and explaina-ble systems, as well as 12,412 citing papers. Using topic modeling, co-occurrence and network analysis, we mapped the research space from diverse domains, such as algorith-mic accountability, interpretable machine learning, context-awareness, cognitive psychology, and software learnability. We reveal fading and burgeoning trends in explainable systems, and identify domains that are closely connected or mostly isolated. The time is ripe for the HCI community to ensure that the powerful new autonomous systems have intelligible interfaces built-in. From our results, we propose several implications and directions for future research to-wards this goal.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 83%
Researching AI Legibility through Design
CHI '20· Explainable AI (XAI) +2
- 83%
Evaluating the Interpretability of Generative Models by Interactive Reconstruction
CHI '21· Explainable AI (XAI) +2
- 83%
Measuring and Understanding Trust Calibrations for Automated Systems: A Survey of the State-Of-The-Art and Future Directions
CHI '23· Explainable AI (XAI) +2
- 83%
RELIC: Investigating Large Language Model Responses using Self-Consistency
CHI '24· Explainable AI (XAI) +2
- 83%
Comparables XAI: Faithful Example-based AI Explanations with Counterfactual Trace Adjustments
CHI '26· Explainable AI (XAI) +2
- 83%
Optimal Explanations: A Quantitative Model of Human Error in Causal Graph Interpretation
IUI '26· Explainable AI (XAI) +2
- 83%
Transferable XAI: Relating Understanding Across Domains with Explanation Transfer
IUI '26· Explainable AI (XAI) +2
- 80%
Manipulating and Measuring Model Interpretability
CHI '21· Explainable AI (XAI) +1
- 80%
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
CHI '21· Explainable AI (XAI) +1
- 80%
Shared Interest: Measuring Human-AI Alignment to Identify Recurring Patterns in Model Behavior
CHI '22· Explainable AI (XAI) +1
Based on Jaccard similarity of research subtopics & professions (≥60%)