How Data Science Workers Work with Data: Discovery, Capture, Curation, Design, Creation
Authors
With the rise of big data, there has been an increasing need for practitioners in this space and an increasing opportunity for researchers to understand their workflows and design new tools to improve it. Data science is often described as data-driven, comprising unambiguous data and proceeding through regularized steps of analysis. However, this view focuses more on abstract processes, pipelines, and workflows, and less on how data science workers engage with the data. In this paper, we build on the work of other CSCW and HCI researchers in describing the ways that scientists, scholars, engineers, and others work with their data, through analyses of interviews with 21 data science professionals. We set five approaches to data along a dimension of interventions: Data as given; as captured; as curated; as designed; and as created. Data science workers develop an intuitive sense of their data and processes, and actively shape their data. We propose new ways to apply these interventions analytically, to make sense of the complex activities around data practices.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 100%
The Story in the Notebook: Exploratory Data Science using a Literate Programming Tool
CHI '18· Interactive Data Visualization +1
- 75%
Understanding and Visualizing Data Iteration in Machine Learning
CHI '20· Interactive Data Visualization +1
- 75%
Tessera: Discretizing Data Analysis Workflows on a Task Level
CHI '21· Interactive Data Visualization +1
- 75%
NBSearch: Semantic Search and Visual Exploration of Computational Notebooks
CHI '21· Interactive Data Visualization +1
- 75%
ComputableViz: Mathematical Operators as a Formalism for Visualization Processing and Analysis
CHI '22· Interactive Data Visualization +1
- 75%
Chartist: Task-driven Eye Movement Control for Chart Reading
CHI '25· Interactive Data Visualization +1
- 75%
Xavier: Toward Better Coding Assistance in Authoring Tabular Data Wrangling Scripts
CHI '25· Interactive Data Visualization +1
- 75%
B2: Bridging Code and Interactive Visualization in Computational Notebooks
UIST '20· Interactive Data Visualization +1
- 67%
Rousillon: Scraping Distributed Hierarchical Web Data
UIST '18· Computational Methods in HCI
- 60%
Evaluating Preference Collection Methods for Interactive Ranking Analytics
CHI '19· Interactive Data Visualization +1
Based on Jaccard similarity of research subtopics & professions (≥60%)