Designing for Reproducibility: A Qualitative Study of Challenges and Opportunities in High Energy Physics
Authors
Reproducibility should be a cornerstone of scientific research and is a growing concern among the scientific community and the public. Understanding how to design services and tools that support documentation, preservation and sharing is required to maximize the positive impact of scientific research. We conducted a study of user attitudes towards systems that support data preservation in High Energy Physics, one of science's most data-intensive branches. We report on our interview study with 12 experimental physicists, studying requirements and opportunities in designing for research preservation and reproducibility. Our findings suggest that we need to design for motivation and benefits in order to stimulate contributions and to address the observed scalability challenge. Therefore, researchers' attitudes towards communication, uncertainty, collaboration and automation need to be reflected in design. Based on our findings, we present a systematic view of user needs and constraints that define the design space of systems supporting reproducible practices.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 80%
Bridging a Bridge: Bringing Two HCI Communities Together
CHI '18· User Research Methods (Interviews, Surveys, Observation) +1
- 80%
Don’t Forget To Be The Way You Are: How to Create a Meaningful and Sustainable Research Identity
CHI '18· User Research Methods (Interviews, Surveys, Observation) +1
- 80%
Don’t Forget To Be The Way You Are: How to Create a Meaningful and Sustainable Research Identity
CHI '18· User Research Methods (Interviews, Surveys, Observation) +1
- 80%
Designing for Knowledge Construction to Facilitate the Uptake of Open Science: Laying out the Design Space
CHI '22· User Research Methods (Interviews, Surveys, Observation) +1
- 80%
Apéritif: Scaffolding Preregistrations to Automatically Generate Analysis Code and Methods Descriptions
CHI '22· Computational Methods in HCI +1
- 80%
Breaking Out of the Ivory Tower: A Large-scale Analysis of Patent Citations to HCI Research
CHI '23· Computational Methods in HCI +1
- 80%
Different Researchers, Different Results? Analyzing the Influence of Researcher Experience and Data Type During Qualitative Analysis of an Interview and Survey Study on Security Advice
CHI '23· User Research Methods (Interviews, Surveys, Observation) +1
- 80%
Toward Living Narrative Reviews: An Empirical Study of the Processes and Challenges in Updating Survey Articles in Computing Research
CHI '25· User Research Methods (Interviews, Surveys, Observation) +1
- 80%
Better Assumptions, Stronger Conclusions: The Case for Ordinal Regression in HCI
CHI '26· User Research Methods (Interviews, Surveys, Observation) +2
- 80%
On the Computational Reproducibility of Human-Computer Interaction
CHI '26· Research Ethics & Open Science +2
Based on Jaccard similarity of research subtopics & professions (≥60%)