StepMIND: A Visual Framework for Stepwise, Multimodal, and Bidirectional Explanations of AI-Generated Data Analysis Pipeline
Best PaperAuthors
Artificial intelligence (AI) enables users to generate data visualizations from natural language descriptions, lowering the barrier to data exploration. However, AI-generated visualizations often present only the final output, lacking transparency and limiting users' ability to verify, interpret, or refine the results. To address this, we introduce \stepmindnospace, a generalizable visual framework that enhances explainability and interactivity in AI-generated data analysis pipelines. \stepmind integrates four dimensions: (1) Stepwise Refinement, allowing users to engage in the AI decision process; (2) Multimodal Explanations, combining natural language, structured notation, direct manipulation, and content visualization for accessible interpretation; (3) Bidirectional Editing, enabling seamless updates across modalities; and (4) Familiar Interaction Models, such as code editor and spreadsheet-based manipulations, to support both technical and non-technical users. To demonstrate its utility, we apply \stepmind in \stagenospace, a case study system for AI-assisted data visualization. A within-subject user study (N=20) shows that \stage significantly improves user confidence and trust, reduces cognitive load, and facilitates both exploratory and corrective refinements. Our findings further suggest that \stepmind can generalize to broader AI-assisted workflows, offering a visible and interactive approach to explainable AI.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 86%
User Ex Machina : Simulation as a Design Probe in Human-in-the-Loop Text Analytics
CHI '21· Explainable AI (XAI) +3
- 75%
Characterizing Practices, Limitations, and Opportunities Related to Text Information Extraction Workflows: A Human-in-the-loop Perspective
CHI '22· AI-Assisted Decision-Making & Automation +2
- 75%
Vipera: Blending Visual and LLM-Driven Guidance for Systematic Auditing of Text-to-Image Generative AI
CHI '26· Explainable AI (XAI) +3
- 71%
Angler: Helping Machine Translation Practitioners Prioritize Model Improvements
CHI '23· Explainable AI (XAI) +2
- 71%
iSEA : An Interactive Pipeline for Semantic Error Analysis of NLP Models
IUI '22· Explainable AI (XAI) +2
- 67%
Beyond Precision: Understanding the Impact of Algorithmic Accuracy and Transparency on User Perceptions in Keyword-Driven Contextual Advertising
CHI '26· Explainable AI (XAI) +3
- 63%
Gamut: A Design Probe to Understand How Data Scientists Understand Machine Learning Models
CHI '19· Explainable AI (XAI) +2
- 63%
Evaluating the Interpretability of Generative Models by Interactive Reconstruction
CHI '21· Explainable AI (XAI) +2
- 63%
RELIC: Investigating Large Language Model Responses using Self-Consistency
CHI '24· Explainable AI (XAI) +2
- 63%
Dango: A Mixed-Initiative Data Wrangling System using Large Language Model
CHI '25· Human-LLM Collaboration +2
Based on Jaccard similarity of research subtopics & professions (≥60%)