Computational Scaffolding of Composition, Value, and Color for Disciplined DrawingOne way illustrators engage in disciplined drawing—the process of drawing to improve technical skills—is through studying and replicating reference images. However, for many novice and intermediate digital artists, knowing how to approach studying a reference image can be challenging. It can also be difficult to receive immediate feedback on their works-in-progress. To help these users develop their professional vision, we propose ArtKrit, a tool that scaffolds the process of replicating a reference image into three main steps: composition, value, and color. At each step, our tool offers computational guidance, such as adaptive composition line generation, and automatic feedback, such as value and color accuracy. Evaluating this tool with intermediate digital artists revealed that ArtKrit could flexibly accommodate their unique workflows and encourage reflection-in-action on their drawing process. As a design probe, ArtKrit suggests that computational scaffolds that enact new norms may drive new artistic insights.2025JMZixian Ma et al.Video Production & EditingCreative Coding & Computational ArtLaser Cutting & Digital FabricationUIST
Reimagining Misuse as Creative Practice: Impressions and Implications of Usage Norms on Digital ArtistsDigital artists use creativity support tools guided by their ideas of “intended use” and therefore "misuse''—but what does misuse mean in creative practice? To discover what constitutes misuse and what creative contexts call for misuse, we interviewed 20 expert creative practitioners across 8 visual art disciplines. We identify five sources of normativity which form conventions of misuse: traditional practices, educational institutions, industry norms, online communities, and tools themselves. We surface why artists defy norms and misuse creative software by exploring how software apathy affects tool engagement, how tool genealogies and personal histories impact artists’ practices, and how artists prioritize practical and professional needs during the creative process. Alongside traditional definitions, we offer artists’ individual perspectives on what misuse means and its relevance to their creative practice. By understanding artists as "mis-users", we present an opportunity to revise how we design for using and misusing creativity support tools.2025ILIsabel Li et al.University of California, BerkeleyCreative Coding & Computational ArtCreative Collaboration & Feedback SystemsCHI
Understanding Temporality of Reflection in Personal Informatics through Baby TrackingPersonal informatics literature has examined reflection in tracking, but there are gaps in our understanding of how self-initiated reflection that one engages in shortly after data collection has taken place occurs in everyday life and how technology can best support it. We use baby tracking as a case study to explore `temporality,' the time over which reflection occurs relative to data collection, as caregivers track their baby's well-being over both short-term and long-term. We interviewed 20 parents in the U.S. who used baby-tracking technology. We find that parents ask different questions based on the time elapsed since data collection, such as checking alignment with medical guidance and prior patterns immediately after tracking or augmenting memory when reflecting hours later. We summarize these findings into a framework for short-term reflection in baby tracking that includes three windows: the immediate, in-between, and cumulative. We use these windows to identify helpful design patterns in baby-tracking technologies toward supporting temporally meaningful reflection and opportunities for further study in other self-tracking domains.2025JLJulianne Louie et al.Pomona CollegeMental Health Apps & Online Support CommunitiesFitness Tracking & Physical Activity MonitoringBiosensors & Physiological MonitoringCHI
Exploring Patient-Generated Annotations to Digital Clinical Symptom Measures for Patient-Centered CommunicationPatients' self-reports are crucial for effective care management of clinical conditions involving subjective symptoms that impact individuals' daily lives. While patients often value the ability to bring in different forms of self-report data to convey their lived experiences, they often face challenges in making their data practically usable in clinical settings. To better center patient needs in communicating illness experiences in clinical settings, we explore the idea of patient annotations to digital clinical self-report measures, specifically in the context of discontinuing antidepressants. Through interviews with 20 patients, we found that participants perceived annotations to digital clinical measures as a means to enrich self-report symptom experiences and enhance patient-centered communication. However, concerns were raised regarding potential interruptions in the professional relationship with providers and the need to account for the sensitivity and complexity of mental health contexts. We discuss opportunities for annotations to promote patient-centered communication by balancing patient-centric communication with clinical practicality and incorporating customization support for patients' communication needs.2024EJEunkyung Jo et al.Session 4b: Patient-Centered Care and Youth EmpowermentCSCW
StreetNav: Leveraging Street Cameras to Support Precise Outdoor Navigation for Blind PedestriansBlind and low-vision (BLV) people rely on GPS-based systems for outdoor navigation. GPS's inaccuracy, however, causes them to veer off track, run into obstacles, and struggle to reach precise destinations. While prior work has made precise navigation possible indoors via hardware installations, enabling this outdoors remains a challenge. Interestingly, many outdoor environments are already instrumented with hardware such as street cameras. In this work, we explore the idea of repurposing existing street cameras for outdoor navigation. Our community-driven approach considers both technical and sociotechnical concerns through engagements with various stakeholders: BLV users, residents, business owners, and Community Board leadership. The resulting system, StreetNav, processes a camera's video feed using computer vision and gives BLV pedestrians real-time navigation assistance. Our evaluations show that StreetNav guides users more precisely than GPS, but its technical performance is sensitive to environmental occlusions and distance from the camera. We discuss future implications for deploying such systems at scale.2024GJGaurav Jain et al.V2X (Vehicle-to-Everything) Communication DesignVisual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)UIST
Front Row: Automatically Generating Immersive Audio Representations of Tennis Broadcasts for Blind ViewersBlind and low-vision (BLV) people face challenges watching sports due to the lack of accessibility of sports broadcasts. Currently, BLV people rely on descriptions from TV commentators, radio announcers, or their friends to understand the game. These descriptions, however, do not allow BLV viewers to visualize the action by themselves. We present Front Row, a system that automatically generates an immersive audio representation of sports broadcasts, specifically tennis, allowing BLV viewers to more directly perceive what is happening in the game. Front Row first recognizes gameplay from the video feed using computer vision, then renders players’ positions and shots via spatialized (3D) audio cues. User evaluations with 12 BLV participants show that Front Row gives BLV viewers a more accurate understanding of the game compared to TV and radio, enabling viewers to form their own opinions on players' moods and strategies. We discuss future implications of Front Row and illustrate several applications, including a Front Row plug-in for video streaming platforms to enable BLV people to visualize the action in sports videos across the Web.2023GJGaurav Jain et al.Visual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)Accessible GamingMental Health Apps & Online Support CommunitiesUIST
A US-UK Usability Evaluation of Consent Management Platform Cookie Consent Interface Design on Desktop and MobileWebsites implement cookie consent interfaces to obtain users’ permission to use non-essential cookies, as required by privacy regulations. We extend prior research evaluating the impact of interface design on cookie consent through an online behavioral experiment (𝑛 = 1359) in which we prompted mobile and desktop users from the UK and US to make cookie consent decisions using one of 14 interfaces implemented with the OneTrust consent management platform (CMP). We found significant effects on user behavior and sentiment for multiple explanatory variables, including more negative sentiment towards the consent process among UK participants and lower comprehension of interface information among mobile users. The design factor that had the largest effect on user behavior was the initial set of options displayed in the cookie banner. In addition to providing more evidence of the inadequacy of current cookie consent processes, our results have implications for website operators and CMPs2023EBElijah Robert Bouma-Sims et al.Carnegie Mellon UniversityPrivacy by Design & User ControlPrivacy Perception & Decision-MakingCHI
Designing Flexible Longitudinal Regimens: Supporting Clinician Planning for Discontinuation of Psychiatric DrugsClinical decision support tools have typically focused on one-time support for diagnosis or prognosis, but have the ability to support providers in longitudinal planning of patient care regimens amidst infrastructural challenges. We explore an opportunity for technology support for discontinuing antidepressants, where clinical guidelines increasingly recommend gradual discontinuation over abruptly stopping to avoid withdrawal symptoms, but providers have varying levels of experience and diverse strategies for supporting patients through discontinuation. We conducted two studies with 12 providers, identifying providers’ needs in developing discontinuation plans and deriving design guidelines. We then iteratively designed and implemented AT Planner, instantiating the guidelines by projecting taper schedules and providing flexibility for adjustment. Provider feedback on AT Planner highlighted that discontinuation plans required balancing interpersonal and infrastructural constraints and surfaced the need for different technological support based on clinical experience. We discuss the benefits and challenges of incorporating flexibility and advice into clinical planning tools.2022EJEunkyung Jo et al.University of California, IrvineIntelligent Tutoring Systems & Learning AnalyticsMental Health Apps & Online Support CommunitiesCHI
Case Studies on the Motivation and Performance of Contributors Who Verify and Maintain In-Flux Tabular DatasetsThe life cycle of a peer-produced dataset follows the phases of growth, maturity, and decline. Paying crowdworkers is a proven method to collect and organize information into structured tables. However, these tabular representations may contain inaccuracies due to errors or data changing over time. Thus, the maturation phase of a dataset can benefit from the additional human examination. One method to improve accuracy is to recruit additional paid crowdworkers to verify and correct errors. An alternative method relies on unpaid contributors, collectively editing the dataset during regular use. We describe two case studies to examine different strategies for human verification and maintenance of in-flux tabular datasets. The first case study examines traditional micro-task verification strategies with paid crowdworkers, while the second examines long-term maintenance strategies with unpaid contributions from non-crowdworkers. Two paid verification strategies that produced more accurate corrections at a lower cost per accurate correction were redundant data collection followed by final verification from a trusted crowdworker and allowing crowdworkers to review any data freely. In the unpaid maintenance strategies, contributors provided more accurate corrections when asked to review data matching their interests. This research identifies considerations and future approaches to collectively improving information accuracy and longevity of tabular information.2021SWShaun Wallace et al.Crowds and Data WorkCSCW
Understanding Delivery of Collectively Built Protocols in an Online Health Community for Discontinuation of Psychiatric DrugsPeople often turn to online health communities (OHCs) for peer support on their specific medical conditions and health-related concerns. Over time, core members in OHCs build a shared understanding of the medical conditions they support. Although prior work has studied how individuals function differently in active sensemaking mode compared to habitual mode, little is known about how OHCs disseminate their advice once their core members operate primarily in habitual mode. We qualitatively observe one such OHC, `Surviving Antidepressants', to understand how collectively-built protocols are disseminated in the important domain of discontinuing psychiatric drugs. Psychiatric drugs are widely prescribed to treat mental health diagnoses, but, in certain cases, discontinuation might be clinically advisable. Unfortunately, some people experience severe withdrawal symptoms upon discontinuation, even when following medical advice, and thus turn to OHCs for support. We find that collectively-built protocols resemble medical advice and are delivered in a top-down fashion, with staff members being the primary source of informational support. In contrast, all members provide emotional support and exchange advice on navigating the medical system, while many express their distrust of the medical community and pharmaceutical companies. We also discuss the implications of OHCs offering advice outside of the medical system and offer suggestions for how OHCs can collaborate with healthcare providers to advance scientific knowledge and better support people living with medical conditions.2021APAlexandra Papoutsaki et al.Online Health CommunitiesCSCW
GuideBand: Intuitive 3D Multilevel Force Guidance on a Wristband in Virtual RealityFor haptic guidance, vibrotactile feedback is a commonly-used mechanism, but requires users to interpret its complicated patterns especially in 3D guidance, which is not intuitive and increases their mental effort. Furthermore, for haptic guidance in virtual reality (VR), not only guidance performance but also realism should be considered. Since vibrotactile feedback interferes with and reduces VR realism, it may not be proper for VR haptic guidance. Therefore, we propose a wearable device, GuideBand, to provide intuitive 3D multilevel force guidance upon the forearm, which reproduces an effect that the forearm is pulled and guided by a virtual guider or telepresent person in VR. GuideBand uses three motors to pull a wristband at different force levels in 3D space. Such feedback usually requires much larger and heavier robotic arms or exoskeletons. We conducted a just-noticeable difference study to understand users’ force level distinguishability. Based on the results, we performed a study to verify that compared with state-of-the-art vibrotactile guidance, GuideBand is more intuitive, needs a lower level of mental effort, and achieves similar guidance performance. We further conducted a VR experience study to observe how users combine and complement visual and force guidance, and prove that GuideBand enhances realism in VR guidance.2021HTHsin-Ruey Tsai et al.National Chengchi UniversityForce Feedback & Pseudo-Haptic WeightFull-Body Interaction & Embodied InputFoot & Wrist InteractionCHI
Effects of Shared Gaze on Audio- Versus Text-Based Remote CollaborationsRemote collaborations are increasingly common, but, despite their many advantages, face unique challenges compared to collocated collaborations. Visualizing the collaborator's point of gaze on a shared screen has been recently explored as a promising way to alleviate some of these limitations by increasing shared awareness. However, prior studies on shared gaze have not considered the medium of communication and have only studied its effect on audio. This paper presents a study that compares the effects of shared gaze on collaboration performance during audio- and text-based communication. We find that for text, shared gaze improved task correctness and led collaborators to look at and talk more about shared content. Similar trends are found for gaze-augmented voice communication, but contrary to the slower performance in text, it also saw improvements in completion time as well as in cognitive workload. Our findings demonstrate the differences in how shared gaze impacts audio- versus text-based communication and highlight the need to further understand the nuances of the medium of communication when designing novel tools to support remote collaborators.2020GKGrete Helena Kütt et al.Coordination and CollaborationCSCW
Eye-Write: Gaze Sharing for Collaborative WritingOnline collaborative writing is an increasingly common practice. Despite its positive effect on productivity and quality of work, it poses challenges to co-authors in remote settings because of limitations in conversational grounding and activity awareness. This paper presents Eye-Write, a novel system which allows two co-authors to see at will the location of their partner's gaze within a text editor. To investigate the effect of shared gaze on collaboration, we conducted a study on synchronous remote collaborative writing in academic settings with 20 dyads. Gaze sharing improved five aspects of perceived collaboration quality: mutual understanding, level of joint attention, flow of communication, level of negotiation, and awareness of the co-author's activity. Furthermore, dyads whose participants deactivated the gaze visualization showed a smaller degree of collaboration. Our findings offer insights for future text editors by outlining the benefits of at-will gaze sharing in collaborative writing.2019GKGrete Helena Kütt et al.Pomona CollegeEye Tracking & Gaze InteractionCreative Collaboration & Feedback SystemsUser Research Methods (Interviews, Surveys, Observation)CHI
Communication Cost of Single-user Gesturing Tool in Laparoscopic Surgical TrainingMulti-user input over a shared display has been shown to support group process and improve performance. However, current gesturing systems for instructional collaborative tasks limit the input to experts and overlook the needs of novices in making references on a shared display. In this paper, we investigate the effects of a single-user gesturing tool on the communication between trainer and trainees in a laparoscopic surgical training. By comparing the communication structure and content between the trainings with and without the gesturing tool, we show that the communication becomes more imbalanced and the trainees become less active when using the single-user gesturing tool. Our findings highlight the needs to grant all parties the same level of access to a shared display and suggest further directions in designing a shared display for instructional collaborative tasks.2019YFYuanyuan Feng et al.University of Maryland, Baltimore CountyHand Gesture RecognitionSurgical Assistance & Medical TrainingHuman-Robot Collaboration (HRC)CHI