Steering AI-driven Personalization of Scientific Text for General AudiencesDigital media platforms (e.g., science blogs) offer opportunities to communicate scientific content to general audiences at scale. However, these audiences vary in their scientific expertise, literacy levels, and personal backgrounds, making effective science communication challenging. To address this challenge, we designed TranSlider, an AI-powered tool that generates personalized translations of scientific text based on individual user profiles (e.g., hobbies, location, and education). Our tool features an interactive slider that allows users to steer the degree of personalization from 0 (weakly relatable) to 100 (strongly relatable), leveraging LLMs to generate the translations with chosen degrees. Through an exploratory study with 15 participants, we investigated both the utility of these AI-personalized translations and how interactive reading features influenced users' understanding and reading experiences. We found that participants who preferred higher degrees of personalization appreciated the relatable and contextual translations, while those who preferred lower degrees valued concise translations with subtle contextualization. Furthermore, participants reported the compounding effect of multiple translations on their understanding of scientific content. Drawing on these findings, we discuss several implications for facilitating science communication and designing steerable interfaces to support human-AI alignment.2025TKTaewook Kim et al.Communicating With/Through AICSCW
FiberCircuits: A Miniaturization Framework To Manufacture Fibers That Embed Integrated CircuitsWhile electronics miniaturization has propelled the evolution of technology from desktops to compact wearables, most devices are still rigid and bulky, often leading to abandonment. To enable interfaces that can truly disappear and seamlessly integrate into daily life, the next evolutionary leap will require further miniaturization to achieve full conformability. With FiberCircuits, we offer design and fabrication guidelines for the manufacturing of high-density circuits that are thin enough for full encapsulation within fibers. Our demonstrations include a 1.4 mm-wide ARM microcontroller with sensors as small as 0.9 mm-wide and arrays of 1 mm-wide addressable LEDs, which were woven into our interactive textiles. We provide example applications from fitness to VR, and propose a scalable fabrication process to enable large-scale deployment. To accelerate future research in HCI, we also made our platform Arduino-compatible, created custom libraries, and open-sourced all the materials. Finally, our technical characterizations demonstrate FiberCircuits' durability, thanks to its silicone encapsulation for waterproofness and braiding for robustness. From wearables to insertables or even implantables, we believe that by making miniature circuits accessible to researchers and beyond, FiberCircuits will open possibilities for new scalable interfaces that embody imperceptible computing.2025CHCedric Honnet et al.Biosensors & Physiological MonitoringElectronic Textiles (E-textiles)Customizable & Personalized ObjectsUIST
Exploring the Design Space of Real-time LLM Knowledge Support Systems: A Case Study of Jargon ExplanationsKnowledge gaps often arise during communication due to diverse backgrounds, knowledge bases, and vocabularies. With recent LLM developments, providing real-time knowledge support is increasingly viable, but is challenging due to shared and individual cognitive limitations (e.g., attention, memory, and comprehension) and the difficulty in understanding the user's context and internal knowledge. To address these challenges, we explore the key question of understanding how people want to receive real-time knowledge support. We built StopGap---a prototype that provides real-time knowledge support for explaining jargon words in videos---to conduct a design probe study (N=24) that explored multiple visual knowledge representation formats. Our study revealed individual differences in preferred representations and highlighted the importance of user agency, personalization, and mixed-initiative assistance. Based on our findings, we map out six key design dimensions for real-time LLM knowledge support systems and offer insights for future research in this space.2025YLYuhan Liu et al.Princeton University, Computer ScienceHuman-LLM CollaborationExplainable AI (XAI)CHI
Designing Accessible and Intuitive Developer Tools for Neuromorphic ProgrammingNeuromorphic technology offers advantages such as low-power processing, low latency, adaptive learning, and noise tolerance, making it ideal for edge computing applications. However, developers face significant hurdles due to the nascent nature of the field, including limited access to hardware and software, lack of benchmarks, and the need for deep interdisciplinary knowledge. Through interviews with 12 practitioners from both industry and academia, we conducted a thematic analysis to understand the current landscape of neuromorphic programming and identified key challenges, workflows, and potential solutions for enhancing accessibility and adoption. Our findings led to a set of guidelines for creating more accessible software development tools and platforms for those looking to create neuromorphic applications. Through this work, we aim to bridge the gap between neuromorphic computing and the HCI community, promoting the design of more intuitive and effective interfaces for neuromorphic development, and ultimately facilitating the creation of edge intelligent systems.2025DUDivesh Upreti et al.George Mason UniversityGenerative AI (Text, Image, Music, Video)AI-Assisted Decision-Making & AutomationComputational Methods in HCICHI
Dual Body Bimanual Coordination in Immersive EnvironmentsA common way to enable immersion in VR is to render a virtual body that mirrors the user's physical movements. VR allows us to design interaction schemes that go beyond direct avatar embodiments. In particular, there is a growing body of literature investigating the simultaneous control of multiple bodies in VR. We contribute to this literature by investigating the important case where multiple bodies perform a coordinated interaction with each other. Such actions directly question what kind of embodiment users experience. Concretely, we investigate people's abilities to perform coordinated bimanual selection and handoff tasks between a first-person and third-person body through a user study with 19 participants. Results provide quantitative \& qualitative evidence for people's ability to perform complex coordinated tasks through two bodies. Furthermore we characterize participant performance in different task and interaction configurations, summarize the strategies they employed, and discuss qualities of user's proprioception.2023JSJames Smith et al.Full-Body Interaction & Embodied InputImmersion & Presence ResearchIdentity & Avatars in XRDIS
A Qualitative Study on the Expectations and Concerns Around Voice and Gesture Interactions in VehiclesMultimodal interactions can reduce cognitive load in demanding situations, such as driving \cite{oviatt2004we,nesselrath2013towards,nesselrath2016combining}. While such interfaces are becoming more mainstream in vehicles, knowledge of situational and contextual factors which influence user preferences about these interactions is sparse. Through semi-structured interviews with 15 individuals, we take a scenario-specific look at perceptions, expectations, and concerns of voice, gesture, and multimodal interactions within vehicles. We presented participants with scenarios where cognitive load, social norms, and other situational factors vary greatly, such as heavy-traffic or multiple passengers. We found situational preferences of voice and gesture shifted greatly, and often contradicted broadly stated preferences. For example, users generally prefer touch, but use voice in complex traffic, and prefer gesture around other occupants to not interrupt conversations. Based on our findings, we share design considerations that can help interaction designers account for variations in user preference when designing modally flexible automotive interfaces.2023APAlexandria Pabst et al.In-Vehicle Haptic, Audio & Multimodal FeedbackHand Gesture RecognitionVoice User Interface (VUI) DesignDIS
MechSense: A Design and Fabrication Pipeline for Integrating Rotary Encoders into 3D Printed MechanismsWe introduce MechSense, 3D-printed rotary encoders that can be fabricated in one pass alongside rotational mechanisms, and report on their angular position, direction of rotation, and speed. MechSense encoders utilize capacitive sensing by integrating a floating capacitor into the rotating element and three capacitive sensor patches in the stationary part of the mechanism. Unlike existing rotary encoders, MechSense does not require manual assembly but can be seamlessly integrated during design and fabrication. Our MechSense editor allows users to integrate the encoder with a rotating mechanism and exports files for 3D-printing. We contribute a sensor topology and a computational model that can compensate for print deviations. Our technical evaluation shows that MechSense can detect the angular position (mean error: 1.4 degree) across multiple prints and rotations, different spacing between sensor patches, and different sizes of sensors. We demonstrate MechSense through three application examples on 3D-printed tools, tangible UIs, and gearboxes.2023MAMarwa AlAlawi et al.MIT CSAILDesktop 3D Printing & Personal FabricationCircuit Making & Hardware PrototypingCHI
Creating Inclusive Voices for the 21st Century: A Non-Binary Text-to-Speech for Conversational AssistantsAs voice assistant usage continues to grow, their homogeneity becomes even more problematic with the UNESCO report, “I’d Blush if I could” showing that designing only feminine voice assistants encourages negative behavior, both with virtual assistants and with real people [3]. While masculine text-to-speech (TTS) voices exist, ones that cover the full range of gender presentations, such as non-binary or gender-ambiguous voices are largely missing. In this paper, we present a method of creating a non-binary TTS voice and an example voice, Sam, created with input from the non-binary and transgender communities. We have open-sourced the resulting voice, along with the process and data used to create it. Finally, we present results from a large-scale survey showing that non-binary individuals are more likely to prefer a non-binary voice assistant compared to cisgendered individuals and discuss differences across age and gender.2023ADAndreea Danielescu et al.Accenture LabsMultilingual & Cross-Cultural Voice InteractionAgent Personality & AnthropomorphismCHI
Functional Destruction: Utilizing sustainable materials' physical transiency for electronics applicationsToday's electronics are manufactured to provide stable functionality and fixed physical forms optimized for reliable operation over long periods and repeated use. However, even when applications don't call for such robustness, the permanency of these electronics comes with environmental consequences. In this paper, we describe an alternative approach that utilizes sustainable transient electronics whose method of destruction is also key to their functionality. We create these electronics through three different methods: 1) by inkjet printing conductive silver traces on poly(vinyl alcohol) (PVA) substrates to create water-soluble sensors; 2) by mixing a conductive beeswax material configured as a meltable sensor; and 3) by fabricating edible electronics with 3D printed chocolate and culinary gold leaf. To enable practical applications of these devices, we implement a fully transient and sustainable chipless RF detection system.2023TCTingyu Cheng et al.Interactive ComputingShape-Changing Interfaces & Soft Robotic MaterialsSustainable HCIEcological Design & Green ComputingCHI
How Experienced Designers of Enterprise Applications Engage AI as a Design MaterialHCI research has explored AI as a design material, suggesting that designers can envision AI's design opportunities to improve UX. Recent research claimed that enterprise applications offer an opportunity for AI innovation at the user experience level. We conducted design workshops to explore the practices of experienced designers who work on cross-functional AI teams in the enterprise. We discussed how designers successfully work with and struggle with AI. Our findings revealed that designers can innovate at the system and service levels. We also discovered that making a case for an AI feature's return on investment is a barrier for designers when they propose AI concepts and ideas. Our discussions produced novel insights on designers' role on AI teams, and the boundary objects they used for collaborating with data scientists. We discuss the implications of these findings as opportunities for future research aiming to empower designers in working with data and AI.2022NYNur Yildirim et al.Carnegie Mellon UniversityGenerative AI (Text, Image, Music, Video)AI-Assisted Decision-Making & AutomationCHI
Designing Tools and Interfaces for Ecological Restoration: An Investigation into the Opportunities and Constraints for Technological InterventionsAs interest within the HCI community expands beyond urban settings, novel tools and devices are being developed to support more sustainable interactions with natural environments and inform conservation action. Yet little is known about the users of these devices, and how their requirements and priorities might affect the usability or operationalization of the devices in the real world. Using the ‘e-seed’, a biomimetic self-drilling interface as a ‘research probe’, we conducted a qualitative user study with 14 subject matter experts in areas like forestry and agriculture to understand the value and limits for devices and systems in ecological restoration and monitoring. We highlight unique challenges in existing ecological practices, opportunities for technological interventions, and the policies and economic constraints affecting the feasibility of such interventions. We present a set of critical design considerations for building and deploying novel devices in natural and semi-natural ecosystems and discuss implications for future research.2022AMAditi Maheshwari et al.Accenture LabsSustainable HCIHuman-Nature Relationships (More-than-Human Design)CHI
Iterative Design of Gestures During Elicitation: Understanding the Role of Increased ProductionPrevious gesture elicitation studies have found that user proposals are influenced by legacy bias which may inhibit users from proposing gestures that are most appropriate for an interaction. Increasing production during elicitation studies has shown promise moving users beyond legacy gestures. However, variety decreases as more symbols are produced. While several studies have used increased production since its introduction, little research has focused on understanding the effect on the proposed gesture quality, on why variety decreases, and on whether increased production should be limited. In this paper, we present a gesture elicitation study aimed at understanding the impact of increased production. We show that users refine the most promising gestures and that how long it takes to find promising gestures varies by participant. We also show that gestural refinements provide insight into the gestural features that matter for users to assign semantic meaning and discuss implications for training gesture classifiers.2022ADAndreea Danielescu et al.Accenture LabsHand Gesture RecognitionCHI
Towards Decomposable Interactive Systems: Design of a Backyard-Degradable Wireless Heating InterfaceSustainability is critical to our planet and thus our designs. Within HCI, there is a tension between the desire to create interactive electronic systems and sustainability. In this paper, we present the design of an interactive system comprising components that are entirely decomposable. We leverage the inherent material properties of natural materials, such as paper, leaf skeletons, and chitosan, along with silver nanowires to create a new system capable of being electrically controlled as a portable heater. This new decomposable system, capable of wirelessly heating to >70°C, is flexible, lightweight, low-cost, and reusable, and it maintains its functionality over long periods of heating and multiple power cycles. We detail its design and present a series of use cases, from enabling a novel resealable packaging system to acting as a catalyst for shape-changing designs and beyond. Finally, we highlight the important decomposable property of the interactive system when it meets end-of-life.2022KSKatherine W Song et al.Accenture Labs, UC BerkeleyShape-Changing Materials & 4D PrintingEcological Design & Green ComputingCHI
Where Responsible AI meets Reality: Practitioner Perspectives on Enablers for shifting Organizational PracticesLarge and ever-evolving technology companies continue to invest more time and resources to incorporate responsible Artificial Intelligence (AI) into production-ready systems to increase algorithmic accountability. This paper examines and seeks to offer a framework for analyzing how organizational culture and structure impact the effectiveness of responsible AI initiatives in practice. We present the results of semi-structured qualitative interviews with practitioners working in industry, investigating common challenges, ethical tensions, and effective enablers for responsible AI initiatives. Focusing on major companies developing or utilizing AI, we have mapped what organizational structures currently support or hinder responsible AI initiatives, what aspirational future processes and structures would best enable effective initiatives, and what key elements comprise the transition from current work practices to the aspirational future.2021BRBogdana Rakova et al.Algorithmic Auditing and Responsible AICSCW
Self-deStaining Textiles: Designing Interactive Systems with Fabric, Stains and LightThis work introduces “destaining” as an interactive component for the HCI community. While staining happens unintentionally (e.g., spilling coffee), destaining can be used as an intentional design tool that selectively degrades stains on textiles. We explore the design space using silver doped titanium dioxide (TiO2/Ag), stains and light as a set of design primitives for interactive systems. We then developed replicable and accessible fabrication and testing methods that enable HCI researchers and designers to upgrade various fabrics to self-destaining textiles. Next, we demonstrate a Self-deStaining textile interface with embedded Light Emitting Diodes (LEDs) and moisture sensors that activate cleaning. Lastly, we showcase how the textile can be used in everyday objects such as self-cleaning clothes, a patterning station for phone cases, and accessories that change patterns and colors based on the user’s experiences.2021FBFiona Bell et al.University of Colorado, BoulderShape-Changing Interfaces & Soft Robotic MaterialsDigital Art Installations & Interactive PerformanceCHI
Is Now A Good Time? An Empirical Study of Vehicle-Driver Communication TimingAdvances in automotive sensing systems and speech interfaces provide new opportunities for smarter driving assistants or infotainment systems. For both safety and consumer satisfaction reasons, any new system which interacts with drivers must do so at appropriate times. We asked 63 drivers, ''Is now a good time?'' to receive non-driving information during a 50-minute drive. We analyzed 2,734 responses and synchronized automotive and video data, and show that while the chances of choosing a good time can be determined with better success using easily accessible automotive data, certain nuances in the problem require a richer understanding of the driver and environment states in order to achieve higher performance. We illustrate several of these nuances with quantitative and qualitative analyses to contribute to the understanding of how to design a system that might simultaneously minimize the risk of interacting at a bad time while maximizing the window of allowable interruption.2019RSRob Semmens et al.Naval Postgraduate SchoolHead-Up Display (HUD) & Advanced Driver Assistance Systems (ADAS)Notification & Interruption ManagementCHI
An Exploration of Speech-Based Productivity Support in the CarIn-car intelligent assistants offer the opportunity to help drivers productively use previously unclaimed time during their commute. However, engaging in secondary tasks can reduce attention on driving and thus may affect road safety. Any interface used while driving, even if speech-based, cannot consider non-driving tasks in isolation of driving---alerts for safer driving and timing of the non-driving tasks are crucial to maintaining safety. In this work, we explore experiences with a speech-based assistant that attempts to help drivers safely complete complex productivity tasks. Via a controlled simulator study, we look at how level of support and road context alerts from the assistant influence a driver's ability to drive safely while writing a document or creating slides via speech. Our results suggest ways to support speech-based productivity interactions and how speech-based road context alerts may influence driver behavior.2019NMNikolas Martelaro et al.Accenture Technology LabsVoice User Interface (VUI) DesignAI-Assisted Decision-Making & AutomationCHI
Human-Robot TeamingThere is sustained and growing interest in human-robot teaming across academia and industry. Many critical questions still remain as to how to foster flexible, effective, teaming that allow humans and robots to work closely together. This panel will bring together experts on human-robot interaction (HRI) across academia and industry to discuss and debate those critical challenges. Panelists will engage the audience in a structured discussion of where current research meets industry demands and the philosophical-to-technical challenges facing the successful integration of human-robot teaming.2018DVDavid W Vinson et al.AccentureHuman-Robot Collaboration (HRC)CHI