Making Multimodal LLMs Reliable Chart Data Extractors: A Benchmark and Training FrameworkChart data extraction, which reverse-engineers data tables from chart images, is essential for reproducibility, analysis, retrieval, and redesign. Existing interactive tools are reliable but tedious, and mixed-initiative systems, while more efficient, lack generalizability. Recent multimodal large language models (MLL…2026YHYuchen He et al.Zhejiang UniversityGenerative AI (Text, Image, Music, Video)Human-LLM CollaborationInteractive Data VisualizationCHI
Cerebra: Aligning Implicit Knowledge in Interactive SQL AuthoringLLM-driven tools have significantly lowered barriers to writing SQL queries. However, user instructions are often underspecified, assuming the model understands implicit knowledge, such as dataset schemas, domain conventions, and task-specific requirements, that isn't explicitly provided. This results in frequently er…2026YZYunfan Zhou et al.Zhejiang UniversityHuman-LLM CollaborationExplainable AI (XAI)Computational Methods in HCICHI
Visualizing Tree-of-analysis: Facilitating Conversational Visual Analytics for NovicesConversational visual analytics (CVA) make data exploration accessible to novices but often leave users disoriented during multi-turn conversations. Previous approaches provide data-centric recommendations, but fail to help users regain orientations. To bridge this gap, we conducted a formative study (N=12) revealing…2026FQFeiyuan Qu et al.Zhejiang UniversityInteractive Data VisualizationExploratory Search & Information SeekingExplainable AI (XAI)CHI
NoteFlow: Leveraging Charts as Sight Glasses for Consistent and Continuous Data Flow TracingComputational notebooks offer a flexible environment for exploratory data analysis (EDA), but this flexibility often leads to disorganized and iterative execution of notebook cells, making it difficult to track how data states evolve. Consequently, data scientists must devote extra mental effort to staying aware of da…2026YTYuan Tian et al.Zhejiang UniversityInteractive Data VisualizationData-Driven Personal Decision-MakingUser Research Methods (Interviews, Surveys, Observation)CHI
TSEditor: Interactive Time Series Editing for Privacy PreservationPublishing time series datasets raises substantial privacy concerns, as the underlying patterns (e.g., trends, values) can lead to the disclosure of individual identification. Mitigating these concerns remains challenging due to difficulties in pinpointing specific privacy-leaking patterns and protecting them without…2026ZXZihan Xu et al.Zhejiang UniversityPrivacy Perception & Decision-MakingInteractive Data VisualizationExplainable AI (XAI)CHI
From Sports Videos to Immersive Training: Augmenting Human Motion to Enrich Basketball Training ExperienceVideo plays a crucial role in sports training, enabling participants to analyze their movements and identify opponents' weaknesses. Despite the easy access to sports videos, the rich motion data within them remains underutilized due to the lack of clear performance indicators and discrepancies from real-game conditio…2025YWYihong Wu et al.Zhejiang UniversityFull-Body Interaction & Embodied InputHuman Pose & Activity RecognitionUIST
ViseGPT: Towards Better Alignment of LLM-generated Data Wrangling Scripts and User PromptsLarge language models (LLMs) enable the rapid generation of data wrangling scripts based on natural language instructions, but these scripts may not fully adhere to user-specified requirements, necessitating careful inspection and iterative refinement. Existing approaches primarily assist users in understanding script…2025JZJiajun Zhu et al.Zhejiang UniversityHuman-LLM CollaborationExplainable AI (XAI)Interactive Data VisualizationUIST
CAnnotator: Photo-Guided Color Annotation for Degraded Ancient PaintingsAncient paintings suffer irreversible color degradation due to aging and improper conservation. Labeling degraded paintings with authentic colors becomes vital to protect these valuable cultural heritages, which is challenging due to missing color information. Users typically need to investigate relevant photos to inf…2025TTTan Tang et al.Zhejiang UniversityMuseum & Cultural Heritage DigitizationInteractive Narrative & Immersive StorytellingUIST
ReSpark: Leveraging Previous Data Reports as References to Generate New Reports with LLMsCreating data reports is a labor-intensive task involving iterative data exploration, insight extraction, and narrative construction. A key challenge lies in composing the analysis logic-from defining objectives and transforming data to identifying and communicating insights. Manually crafting this logic can be cognit…2025YTYuan Tian et al.Zhejiang UniversityHuman-LLM CollaborationInteractive Data VisualizationData StorytellingUIST
VisMimic: Integrating Motion Chain in Feedback Video Generation for Motor CoachingAugmented video is a common medium for remote sports coaching, facilitating communication between trainees and coaches. Existing video augmentation techniques struggle to simultaneously convey both the overall motion dynamics and static key poses. This limitation hinders feedback comprehension in motor learning, makin…2025LCLiqi Cheng et al.Zhejiang UniversityFull-Body Interaction & Embodied InputHuman Pose & Activity RecognitionUIST
TableCanoniser: Interactive Grammar-Powered Transformation of Messy, Non-Relational Tables to Canonical TablesTableCanoniser is a declarative grammar and interactive system for constructing relational tables from messy tabular inputs such as spreadsheets. We propose the concept of axis alignment to categorise input types and characterise the expanded scope of our system relative to existing tools. The declarative grammar cons…2025KXKai Xiong et al.Zhejiang UniversityInteractive Data VisualizationPrototyping & User TestingCHI
RidgeBuilder: Interactive Authoring of Expressive Ridgeline PlotsRidgeline plots are frequently employed to visualize the evolution or distributions of multiple series with a pile of overlapping line, area, or bar charts, highlighting the peak patterns. While traditionally viewed as small multiple visualizations, their ridge-like patterns have increasingly attracted graphic designe…2025SLShuhan Liu et al.Zhejiang UniversityInteractive Data VisualizationData StorytellingCHI
ProTAL: A Drag-and-Link Video Programming Framework for Temporal Action LocalizationTemporal Action Localization (TAL) aims to detect the start and end timestamps of actions in a video. However, the training of TAL models requires a substantial amount of manually annotated data. Data programming is an efficient method to create training labels with a series of human-defined labeling functions. Howeve…2025YHYuchen He et al.Zhejiang UniversityInteractive Data VisualizationComputational Methods in HCICHI
StructVizor: Interactive Profiling of Semi-Structured Textual DataData profiling plays a critical role in understanding the structure of complex datasets and supporting numerous downstream tasks, such as social media analytics and financial fraud detection. While existing research predominantly focuses on structured data formats, a substantial portion of semi-structured textual data…2025YHYanwei Huang et al.Zhejiang UniversityInteractive Data VisualizationTime-Series & Network Graph VisualizationVisualization Perception & CognitionCHI
Xavier: Toward Better Coding Assistance in Authoring Tabular Data Wrangling ScriptsData analysts frequently employ code completion tools in writing custom scripts to tackle complex tabular data wrangling tasks. However, existing tools do not sufficiently link the data contexts such as schemas and values with the code being edited. This not only leads to poor code suggestions, but also frequent inter…2025YZYunfan Zhou et al.Zhejiang UniversityInteractive Data VisualizationComputational Methods in HCICHI
VisCourt: In-Situ Guidance for Interactive Tactic Training in Mixed RealityIn team sports like basketball, understanding and executing tactics---coordinated plans of movements among players---are crucial yet complex, requiring extensive practice. These tactics require players to develop a keen sense of spatial and situational awareness. Traditional coaching methods, which mainly rely on bask…2024LCLiqi Cheng et al.Zhejiang UniversityFull-Body Interaction & Embodied InputMixed Reality WorkspacesImmersion & Presence ResearchUIST
Understanding Nonlinear Collaboration between Human and AI Agents: A Co-design Framework for Creative DesignCreative design is a nonlinear process where designers generate diverse ideas in the pursuit of an open-ended goal and converge towards consensus through iterative remixing. In contrast, AI-powered design tools often employ a linear sequence of incremental and precise instructions to approximate design objectives. S…2024JZJiayi Zhou et al.Zhejiang UniversityGenerative AI (Text, Image, Music, Video)Human-LLM CollaborationCreative Collaboration & Feedback SystemsCHI
VAID: Indexing View Designs in Visual Analytics SystemVisual analytics (VA) systems have been widely used in various application domains. However, VA systems are complex in design, which imposes a serious problem: although the academic community constantly designs and implements new designs, the designs are difficult to query, understand, and refer to by subsequent desig…2024LYLu Ying et al.Zhejiang UniversityInteractive Data VisualizationVisualization Perception & CognitionCHI
Table Illustrator: Puzzle-based interactive authoring of plain tablesPlain tables excel at displaying data details and are widely used in data presentation, often polished to an elaborate appearance for readability in many scenarios. However, existing authoring tools fail to provide both flexible and efficient support for altering the table layout and styles, motivating us to develop a…2024YHYanwei Huang et al.Zhejiang UniversityInteractive Data VisualizationData StorytellingCHI
PColorizor: Re-coloring Ancient Chinese Paintings with Ideorealm-congruent PoemsColor restoration of ancient Chinese paintings plays a significant role in Chinese culture protection and inheritance. However, traditional color restoration is challenging and time-consuming because it requires professional restorers to conduct detailed literature reviews on numerous paintings for reference colors. A…2023TTTan Tang et al.Zhejiang UniversityGenerative AI (Text, Image, Music, Video)Data StorytellingMuseum & Cultural Heritage DigitizationUIST