Tutorial mismatches: understanding the frictions due to interface differences when following software video tutorialsVideo tutorials are the main medium to learn novel software skills. However, the User Interface (UI) presented in a video tutorial may differ from the learner's UI because of customizations or differences in software versions. We investigate the frictions resulting from such differences on a learners' ability to reproduce a task demonstrated in a video tutorial. Through a morphological analysis, we first identify 13 types of "interface differences" that differ in terms of availability, reachability and spatial location of features in the interface. To better assess the frictions resulting from each of these differences, we then conduct a laboratory study with 26 participants instructed to reproduce a vector graphics editing task. Our results highlight interesting UI comparison behaviors, and illustrate various approaches employed to visually locate features.2024RPRaphaël Perraud et al.Programming Education & Computational ThinkingUser Research Methods (Interviews, Surveys, Observation)Prototyping & User TestingDIS
Sensing Care Through Design - A Speculative Role-play Approach to “Living With” Sensor-Supported Care NetworksSensor networks are increasingly commonplace in visions of smart cities and future healthcare systems, promising greater efficiency and increased wellbeing. However, the design of these technologies remains focused on specific users and fragmented by context, overlooking the diversity of needs, wants and values present when technologies, people, and lived realities interact within instrumented spaces. In this paper we present a workshop method – Sensing Care – that can help researchers, interdisciplinary design and development teams, and potentially affected users, to explore what it takes to design for living with sensor technologies that intersect and interact across private and public spaces, through speculative scenarios and role play. Drawing from three deployments of the workshop, we discuss how this approach supports the design of future care-oriented sensor networks, and helps designers understand what it means to live with complex technologies as people traverse diverse contexts.2023SRSonja Rattay et al.Participatory DesignField StudiesSustainable HCIDIS
On the state of reporting in crowdsourcing experiments and a checklist to aid current practicesCrowdsourcing is being increasingly adopted as a platform to run studies with human subjects. Running a crowdsourcing experiment involves several choices and strategies to successfully port an experimental design into an otherwise uncontrolled research environment, e.g., sampling crowd workers, mapping experimental conditions to micro-tasks, or ensure quality contributions. While several guidelines inform researchers in these choices, guidance of how and what to report from crowdsourcing experiments has been largely overlooked. If under-reported, implementation choices constitute variability sources that can affect the experiment's reproducibility and prevent a fair assessment of research outcomes. In this paper, we examine the current state of reporting of crowdsourcing experiments and offer guidance to address associated reporting issues. We start by identifying sensible implementation choices, relying on existing literature and interviews with experts, to then extensively analyze the reporting of 171 crowdsourcing experiments. Informed by this process, we propose a checklist for reporting crowdsourcing experiments.2021JRJorge Ramirez et al.Methods and Design ApproachesCSCW
Putting Down Roots: Exploring the Placeness of Virtual Collections in Public LibrariesIn this pictorial, we investigate how a virtual collection can put down its roots in a physical space and integrate into the local community. We present PLACED, a place-centric digital service that supports participation and community-production of knowledge in library events. We illustrate how PLACED has been deployed and used at a local public library over a six-month period. We examine the community-produced virtual collection that grew out of this library event with a focus on its placeness.2020DYDaisy Yoo et al.Misinformation & Fact-CheckingCommunity Collaboration & WikipediaCommunity Engagement & Civic TechnologyDIS
Computational Alternatives Vignettes for Place- and Activity-Centered Digital Services in Public LibrariesWe investigate how to design community technologies for public events. We do so with a focus on technologies that give rise to new forms of participation and knowledge co-production in public libraries. Specifically, we deployed a digital service at a major public library during its four-week creative workshop series. The system offered an alternative way for people to work together as a community, to go beyond achieving individual goals, and to contribute to the achievement of public goals (e.g., building community bookshelves). We report on how the system has reconfigured physical spaces and afforded new social practices in the library. We propose Computational Alternatives as a fruitful approach for gaining situated, nuanced insights into a technology's possible adoption. We offer key insights in the form of computational alternatives vignettes -- grounded stories that encapsulate sociotechnical implications of technology, pointing to plausible alternative futures.2020DYDaisy Yoo et al.Aarhus UniversityCommunity Engagement & Civic TechnologyParticipatory DesignField StudiesCHI
Exploration and Explanation in Computational NotebooksComputational notebooks combine code, visualizations, and text in a single document. Researchers, data analysts, and even journalists are rapidly adopting this new medium. We present three studies of how they are using notebooks to document and share exploratory data analyses. In the first, we analyzed over 1 million computational notebooks on GitHub, finding that one in four had no explanatory text but consisted entirely of visualizations or code. In a second study, we examined over 200 academic computational notebooks, finding that although the vast majority described methods, only a minority discussed reasoning or results. In a third study, we interviewed 15 academic data analysts, finding that most considered computational notebooks personal, exploratory, and messy. Importantly, they typically used other media to share analyses. These studies demonstrate a tension between exploration and explanation in constructing and sharing computational notebooks. We conclude with opportunities to encourage explanation in computational media without hindering exploration.2018ARAdam Rule et al.UC San DiegoInteractive Data VisualizationData StorytellingCHI
Using Visual Histories to Reconstruct the Mental Context of Suspended ActivitiesResuming suspended activities is fundamental to knowledge work. As activities grow in complexity or fade from memory, they become increasingly difficult to cognitively resume. Motivated by the efficiency of images for cueing autobiographical memory, we conducted 2 studies of how visual histories of computer-mediated activity might aid users in restoring the mental context of suspended activities. In the first exploratory study we demonstrate that users provided a visual history consisting of small thumbnail images of their desktop can reconstruct detailed mental contexts of earlier computer work. In the second observational study we examine methods and cues that web developers, scientific writers, and graphic designers currently use to restore mental context. We find that participants from all three professions engage in situated sensemaking, reconstructing context by generating stories to explain cues in their documents with implicit meaning, such as sudden changes in writing quality or the shape of blocks of code. We identify characteristics of each activity that influence the information, artifacts, and strategies participants used to reconstruct context. We conclude that visual histories can help users reconstruct mental context but that challenges remain in designing lightweight image-based cues that help users reconstruct context for a range of activities.2018ARAdam Rule et al.UC San DiegoKnowledge Worker Tools & WorkflowsNotification & Interruption ManagementCHI