HARK No More: On the Preregistration of CHI Experiments
Best PaperAuthors
Experimental preregistration is required for publication in many scientific disciplines and venues. When experimental intentions are preregistered, reviewers and readers can be confident that experimental evidence in support of reported hypotheses is not the result of HARKing, which stands for Hypothesising After the Results are Known. We review the motivation and outcomes of experimental preregistration across a variety of disciplines, as well as previous work commenting on the role of evaluation in HCI research. We then discuss how experimental preregistration could be adapted to the distinctive characteristics of Human-Computer Interaction empirical research, to the betterment of the discipline.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 75%
Designing Ground Truth and the Social Life of Labels
CHI '21· Computational Methods in HCI +1
- 75%
Consumption Experiences in the Research Process
CHI '22· Computational Methods in HCI +1
- 75%
Apéritif: Scaffolding Preregistrations to Automatically Generate Analysis Code and Methods Descriptions
CHI '22· Computational Methods in HCI +1
- 75%
Breaking Out of the Ivory Tower: A Large-scale Analysis of Patent Citations to HCI Research
CHI '23· Computational Methods in HCI +1
- 75%
Better Assumptions, Stronger Conclusions: The Case for Ordinal Regression in HCI
CHI '26· User Research Methods (Interviews, Surveys, Observation) +2
- 75%
On the Computational Reproducibility of Human-Computer Interaction
CHI '26· Research Ethics & Open Science +2
- 75%
Opportunities and Limits of Online Video Studies
DIS '25· User Research Methods (Interviews, Surveys, Observation) +2
- 67%
Technology which Makes You Think: The Reflection, Rumination and Thought in Technology Scale
UbiComp '24· Computational Methods in HCI +1
- 60%
Special Interest Group on Transparent Statistics Guidelines
CHI '18· Computational Methods in HCI +1
- 60%
Designing for Reproducibility: A Qualitative Study of Challenges and Opportunities in High Energy Physics
CHI '19· User Research Methods (Interviews, Surveys, Observation) +2
Based on Jaccard similarity of research subtopics & professions (≥60%)