Rememo: A Research-through-Design Inquiry Towards an AI-in-the-loop Therapist’s Tool for Dementia ReminiscenceReminiscence therapy (RT) is a common non-pharmacological intervention in dementia care. Recent technology-mediated interventions have largely focused on people with dementia through solutions that replace human facilitators with conversational agents. However, the relational work of facilitation is critical in the effectiveness of RT. Hence, we developed Rememo, a therapist-oriented tool that integrates Generative AI to support and enrich human facilitation in RT. Our tool aims to support the infrastructural and cultural challenges that therapists in Singapore face. In this research, we contribute the Rememo system as a therapist’s tool for personalized RT developed through sociotechnically-aware research-through-design. Through studying this system in-situ, our research extends our understanding of human-AI collaboration for care work. We discuss the implications of designing AI-enabled systems that respect the relational dynamics in care contexts, and argue for a rethinking of synthetic imagery as a therapeutic support for memory rather than a record of truth.2026CSCeleste Seah et al.National University of SingaporeVR Medical Training & RehabilitationAI-Assisted Decision-Making & AutomationMental Health Apps & Online Support CommunitiesCHI
Crafting Interactive Paper Composites through Ancient Papermaking TechniquesPapermaking is an ancient yet evolving craft, with changes in techniques and materials giving paper contemporary qualities that keep it relevant for everyday use. This adaptability makes papermaking an ideal process for crafting computational composites for tangible interactions. We began by studying ancient Chinese papermaking, replicating it by hand and simplifying the practice into five key steps and tools accessible to novices. We then adapted these steps to imbue the paper with interactive and computational properties, such as integrating conductive materials during pulp preparation, modifying fiber properties through soaking, and customizing sheet texture through watermarking, multi-layering, and coating. We detail our exploration in this paper, as well as demonstrate our findings through four interactive systems focusing on expressive applications made with the computational paper from our adapted process. We also document our exploration in a detailed workbook that captures recipes, failures, and key moments of discovery.2025QYQian Ye et al.National University of Signapore, Design and EngineeringShape-Changing Interfaces & Soft Robotic MaterialsCircuit Making & Hardware PrototypingCustomizable & Personalized ObjectsCHI
Slip Casting as a Machine for Making Textured Ceramic InterfacesCeramics provide a rich domain for exploring craft, fabrication, and diverse material textures that enhance tangible interaction. In this work, we explored slip-casting, a traditional ceramic technique where liquid clay is poured into a porous plaster mold that absorbs water from the slip to form a clay body. We adapted this process into an approach we called Resist Slip-Casting. By selectively masking the mold’s surface with stickers to vary its water absorption rate, our approach enables makers to create ceramic objects with intricate textured surfaces, while also allowing the customization of a single mold for different outcomes. In this paper, we detail the resist slip-casting process and demonstrate its application by crafting a range of tangible interfaces with customizable visual symbols, tactile features, and decorative elements. We further discuss our approach within the broader conversation in HCI on fabrication machines that promote creative collaboration between humans, materials, and tools.2025BHBo Han et al.National University of Singapore, Division of Industrial DesignShape-Changing Interfaces & Soft Robotic MaterialsCustomizable & Personalized ObjectsCHI
Designing Physical Interactions with Triboelectric Material SensingPhysical interactions in Human-Computer Interaction (HCI) provide immersive ways for people to engage with technology. However, designers face challenges in integrating physical computing and modeling when designing physical interactions. We explore triboelectric material sensing, a promising technology that addresses these challenges, though its use within the design community remains underexplored. To bridge this gap, we develop a toolkit consisting of triboelectric material pairs, a mechanism taxonomy, a signal processing tool, and computer program templates. We introduce this toolkit to designers in two workshops, where reflections on the design process highlight its effectiveness and inspire innovative interaction designs. Our work contributes valuable resources and knowledge to the design community, making triboelectric sensing more accessible and fostering creativity in physical interaction design.2025XLXin Liu et al.National University of Singapore, Division of Industrial Design; National University of Singapore, Keio-NUS CUTE CenterShape-Changing Interfaces & Soft Robotic MaterialsCircuit Making & Hardware PrototypingCHI
Bridging Simulation and Reality: Augmented Virtuality for Mass Casualty Triage Training - From Landscape Analysis to Empirical InsightsLive drills are the gold standard for mass casualty incident (MCI) training but are often too resource-intensive for widespread implementation. Immersive technologies offer a promising alternative, but can they deliver comparable fidelity and effectiveness? Working with a local disaster response academy, this paper investigated the potential of Augmented Virtuality (AV) in MCI training through two phases. First, we conducted a landscape analysis of 126 papers across the virtuality continuum, revealing trends in population, training focus, and evaluation metrics. Second, we empirically evaluated an AV system for mass casualty triage training against traditional role-playing and Virtual Reality (VR) approaches, involving 60 trainees in an operational curriculum. Results indicated that both AV and VR surpassed traditional simulations, with AV's tactile integration significantly enhancing physical engagement, satisfaction, and triage accuracy. Through the lens of triage, we discussed the broader practical implications of integrating immersive technologies like AV into real-world MCI education.2025YCYang Chen et al.National University of Singapore, College of Design and EngineeringSocial & Collaborative VRVR Medical Training & RehabilitationCHI
E-Acrylic: Electronic-Acrylic Composites for Making Interactive ArtifactsElectronic composites incorporate computing into physical materials, expanding the materiality of interactive systems for designers. In this research, we investigated acrylic as a substrate for electronics. Acrylic is valued for its visual and structural properties and is used widely in industrial design. We propose e-acrylic, an electronic composite that incorporates electronic circuits with acrylic sheets. Our approach to making this composite is centered on acrylic making practices that industrial designers are familiar with. We outline this approach systematically, including leveraging laser cutting to embed circuits into acrylic sheets, as well as different ways to shape e-acrylic into 3D objects. With this approach, we explored using e-acrylic to design interactive artifacts. We reflect on these applications to surface a design space of tangible interactive artifacts possible with this composite. We also discuss the implications of aligning electronics to an existing making practice, and working with the holistic materiality that e-acrylic embodies.2024BHBo Han et al.National University of SingaporeShape-Changing Interfaces & Soft Robotic MaterialsShape-Changing Materials & 4D PrintingDigital Art Installations & Interactive PerformanceCHI
Reconfigurable Interfaces by Shape Change and Embedded MagnetsReconfigurable physical interfaces empower users to swiftly adapt to tailored design requirements or preferences. Shape-changing interfaces enable such reconfigurability, avoiding the cost of refabrication or part replacements. Nonetheless, reconfigurable interfaces are often bulky, expensive, or inaccessible. We propose a reversible shape-changing mechanism that enables reconfigurable 3D printed structures via translations and rotations of parts. We investigate fabrication techniques that enable reconfiguration using magnets and the thermoplasticity of heated polymer. Proposed interfaces achieve tunable haptic feedback and adjustment of different user affordances by reconfiguring input motions. The design space is demonstrated through applications in rehabilitation, embodied communication, accessibility, safety, and gaming.2024HDHimani Deshpande et al.Texas A&M UniversityForce Feedback & Pseudo-Haptic WeightShape-Changing Interfaces & Soft Robotic MaterialsShape-Changing Materials & 4D PrintingCHI
PaperTouch: Tangible Interfaces through Paper Craft and Touchscreen DevicesPaper and touchscreen devices are two common objects found around us, and we investigated the potential of their intersection for tangible interface design. In this research, we developed PaperTouch, an approach to design paper based mechanisms that translate a variety of physical interactions to touch events on a capacitive touchscreen. These mechanisms act as switches that close during interaction, connecting the touchscreen to the device’s ground bus. To develop PaperTouch, we explored different types of paper along with the making process around them. We also built a range of applications to showcase different tangible interfaces facilitated with PaperTouch, including music instruments, educational dioramas, and playful products. By reflecting on this exploration, we uncovered the emerging design dimensions that considers the interactions, materiality, and embodiment of PaperTouch interfaces. We also surfaced the tacit know-how that we gained through our design process through annotations for others to refer to.2024QYQian Ye et al.National University of SingaporeShape-Changing Materials & 4D PrintingCustomizable & Personalized ObjectsCHI
Marking Material Interactions with Computer VisionThe electronics-centered approach to physical computing presents challenges when designers build tangible interactive systems due to its inherent emphasis on circuitry and electronic components. To explore an alternative physical computing approach we have developed a computer vision (CV) based system that uses a webcam, computer, and printed fiducial markers to create functional tangible interfaces. Through a series of design studios, we probed how designers build tangible interfaces with this CV-driven approach. In this paper, we apply the annotated portfolio method to reflect on the fifteen outcomes from these studios. We observed that CV markers offer versatile materiality for tangible interactions, afford the use of democratic materials for interface construction, and engage designers in embodied debugging with their own vision as a proxy for CV. By sharing our insights, we inform other designers and educators who seek alternative ways to facilitate physical computing and tangible interaction design.2023PGPeter Gyory et al.University of Colorado BoulderShape-Changing Interfaces & Soft Robotic MaterialsComputational Methods in HCICHI
Crafting Interactive Circuits on Glazed Ceramic WareGlazed ceramic is a versatile material that we use every day. In this paper, we present a new approach that instruments existing glazed ceramic ware with interactive electronic circuits. We informed this work by collaborating with a ceramics designer and connected his craft practice to our experience in physical computing. From this partnership, we developed a systematic approach that begins with the subtractive fabrication of traces on glazed ceramic surfaces via the resist-blasting technique, followed by applying conductive ink into the inlaid traces. We capture and detail this approach through an annotated flowchart for others to refer to, as well as externalize the material insights we uncovered through ceramic and circuit swatches. We then demonstrate a range of interactive home applications built with this approach. Finally, we reflect on the process we took and discuss the importance of collaborating with craftspeople for material-driven research within HCI.2023CZClement Zheng et al.National University of Singapore, National University of SingaporeCircuit Making & Hardware PrototypingTextile Art & Craft DigitizationCHI
SwellSense: Creating 2.5D interactions with micro-capsule paperIn this paper, we propose SwellSense, a fabrication technique to screen print stretchable circuits onto a special micro-capsule paper, creating localized swelling patterns with sensing capabilities. This simple technique will allow users to create a wide range of paper-based tactile interactive devices, which are mostly maintaining 2D planar form factor but can also be curved or folded into 3D interactive artifacts. We first present the design guidelines to support various tactile interaction design including basic tactile graphic geometries, patterns with directional density, or finer interactive textures with embedded sensing such as touch sensor, pressure sensor, and mechanical switch. We then provide a design editor to enable users to design more creatively using the SwellSense technique. We provide a technical evaluation and user evaluation to validate the basic performance of SwellSense. Lastly, we demonstrate several application examples and conclude with a discussion on current limitations and future work.2023TCTingyu Cheng et al.Interactive ComputingShape-Changing Interfaces & Soft Robotic MaterialsData PhysicalizationMuseum & Cultural Heritage DigitizationCHI
Build Your Own Arcade Machine with TinycadeTinycade is a platform designed to help game designers build their own mini arcade games by hand. With this platform, one can craft functioning game controllers out of everyday materials such as cardboard and toothpicks. By utilizing computer vision markers, we can create a variety of inputs without a single wire. In this pictorial, we discuss the functionality of Tinycade and showcase three games that demonstrate the variety of controls possible with this platform.2022PGPeter Gyory et al.Digitalization of Board & Tabletop GamesDesktop 3D Printing & Personal FabricationMakerspace CultureC&C
Making Data Tangible: A Cross-disciplinary Design Space for Data PhysicalizationDesigning a data physicalization requires a myriad of different considerations. Despite the cross-disciplinary nature of these considerations, research currently lacks a synthesis across the different communities data physicalization sits upon, including their approaches, theories, and even terminologies. To bridge these communities synergistically, we present a design space that describes and analyzes physicalizations according to three facets: context (end-user considerations), structure (the physical structure of the artifact), and interactions (interactions with both the artifact and data). We construct this design space through a systematic review of 47 physicalizations and analyze the interrelationships of key factors when designing a physicalization. This design space cross-pollinates knowledge from relevant HCI communities, providing a cohesive overview of what designers should consider when creating a data physicalization while suggesting new design possibilities. We analyze the design decisions present in current physicalizations, discuss emerging trends, and identify underlying open challenges.2022SBS. Sandra Bae et al.University of Colorado BoulderData PhysicalizationCHI
FlexHaptics: A Design Method for Passive Haptic Inputs Using Planar Compliant StructuresThis paper presents FlexHaptics, a design method for creating custom haptic input interfaces. Our approach leverages planar compliant structures whose force-deformation relationship can be altered by adjusting the geometries. Embedded with such structures, a FlexHaptics module exerts a fine-tunable haptic effect (i.e., resistance, detent, or bounce) along a movement path (i.e., linear, rotary, or ortho-planar). These modules can work separately or combine into an interface with complex movement paths and haptic effects. To enable the parametric design of FlexHaptic modules, we provide a design editor that converts user-specified haptic properties into underlying mechanical structures of haptic modules. We validate our approach and demonstrate the potential of FlexHaptic modules through six application examples, including a slider control for a painting application and a piano keyboard interface on touchscreens, a tactile low vision timer, VR game controllers, and a compound input device of a joystick and a two-step button.2022HLHongnan Lin et al.Georgia Institute of TechnologyForce Feedback & Pseudo-Haptic WeightShape-Changing Interfaces & Soft Robotic MaterialsPrototyping & User TestingCHI
Shape-Haptics: Planar & Passive Force Feedback Mechanisms for Physical InterfacesWe present Shape-Haptics, an approach for designers to rapidly design and fabricate passive force feedback mechanisms for physical interfaces. Such mechanisms are used in everyday interfaces and tools, and they are challenging to design. Shape-Haptics abstracts and broadens the haptic expression of this class of force feedback systems through 2D laser cut configurations that are simple to fabricate. They leverage the properties of polyoxymethylene plastic and comprise a compliant spring structure that engages with a sliding profile during tangible interaction. By shaping the sliding profile, designers can easily customize the haptic force feedback delivered by the mechanism. We provide a computational design sandbox to facilitate designers to explore and fabricate Shape-Haptics mechanisms. We also propose a series of applications that demonstrate the utility of Shape-Haptics in creating and customizing haptics for different physical interfaces.2022CZClement Zheng et al.National University of SingaporeForce Feedback & Pseudo-Haptic WeightLaser Cutting & Digital FabricationCHI