Facilitating Document Reading by Linking Text and Tables
Authors
Document authors commonly use tables to support arguments presented in the text. But, because tables are usually separate from the main body text, readers must split their attention between different parts of the document. We present an interactive document reader that automatically links document text with corresponding table cells. Readers can select a sentence (or tables cells) and our reader highlights the relevant table cells (or sentences). We provide an automatic pipeline for extracting such references between sentence text and table cells for existing PDF documents that combines structural analysis of tables with natural language processing and rule-based matching. On a test corpus of 330 (sentence, table) pairs, our pipeline correctly extracts 48.8% of the references. An additional 30.5% contain only false negatives (FN) errors -- the reference is missing table cells. The remaining 20.7% contain false positives (FP) errors -- the reference includes extraneous table cells and could therefore mislead readers. A user study finds that despite such errors, our interactive document reader helps readers match sentences with corresponding table cells more accurately and quickly than a baseline document reader.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 100%
VINS: Visual Search for Mobile User Interface Design
CHI '21· Interactive Data Visualization +1
- 100%
Replay Enactments: Exploring Possible Futures through Historical Data
DIS '20· Interactive Data Visualization +1
- 80%
Familiarisation: Restructuring Layouts with Visual Learning Models
IUI '18· Interactive Data Visualization +2
- 75%
From Detectables to Inspectables: Understanding Qualitative Analysis of Audiovisual Data
CHI '21· Interactive Data Visualization +1
- 75%
Interaction Illustration Taxonomy: Classification of Styles and Techniques for Visually Representing Interaction Scenarios
CHI '21· Interactive Data Visualization +1
- 75%
Relative Design Acquisition: A Computational Approach for Creating Visual Interfaces to Steer User Choices
CHI '23· Computational Methods in HCI
- 75%
DeepSI: Interactive Deep Learning for Semantic Interaction
IUI '21· Computational Methods in HCI
- 60%
Predicting Human Performance in Vertical Menu Selection Using Deep Learning
CHI '18· Recommender System UX +1
- 60%
Visualizing API Usage Examples at Scale
CHI '18· Interactive Data Visualization +1
- 60%
Paragon: An Online Gallery for Enhancing Design Feedback with Visual Examples
CHI '18· Interactive Data Visualization +1
Based on Jaccard similarity of research subtopics & professions (≥60%)