RealTwin: Concept Graph Representation and Grounding Framework for Reality-Preserving Digital Twin ReconstructionReconstructing realistic digital twins has become crucial as advances in mixed reality, metaverse, and robotics demand more accurate simulations for the physical world. Despite technical progress, building high-fidelity digital twins from a systematic and human-centered perspective remains underexplored. Drawing from…2026ZLZisu Li et al.Hong Kong University of Science and TechnologyImmersion & Presence ResearchMixed Reality WorkspacesHuman-LLM CollaborationCHI
MoXaRt: Audio-Visual Object-Guided Sound Interaction for XRIn Extended Reality (XR), complex acoustic environments often overwhelm users, compromising both scene awareness and social engagement due to entangled sound sources. We introduce MoXaRt, a real-time XR system that uses audio-visual cues to separate these sources and enable fine-grained sound interaction. MoXaRt's cor…2026TXTianyu Xu et al.GoogleImmersion & Presence ResearchSpatial Audio & 3D SoundCHI
EI-Lite: Electrical Impedance Sensing for Micro-gesture Recognition and Pinch Force EstimationMicro-gesture recognition and fine-grain pinch press enables intuitive and discreet control of devices, offering significant potential for enhancing human-computer interaction (HCI). In this paper, we present EI-Lite, a lightweight wrist-worn electrical impedance sensing device for micro-gesture recognition and contin…2025JZJunyi Zhu et al.Massachusetts Institute of TechnologyVibrotactile Feedback & Skin StimulationFoot & Wrist InteractionUIST
BandEI: A Flexible Electrical Impedance Sensing Bandage for Deep Muscles and TendonsMonitoring deep muscles and tissues is critical for rehabilitation, training, and fine motor control. In this work, we propose BandEI, a flexible, bandage-like wearable sensor for electrical impedance sensing. BandEI utilizes woven conductive fabric as the core material for its electrodes and leverages digital fabrica…2025HWHongrui Wu et al.University Of WashingtonVibrotactile Feedback & Skin StimulationHaptic WearablesHuman Pose & Activity RecognitionUIST
Meta-antenna: Mechanically Frequency Reconfigurable Metamaterial AntennasWe introduce Meta-antenna, a design and fabrication pipeline for creating frequency reconfigurable antennas while making use of a single type of mechanical metamaterial structure. Unlike traditional static antenna systems with fixed radiation patterns and frequency responses per geometry, Meta-antenna leverages mechan…2025MAMarwa AlAlawi et al.Massachusetts Institute of TechnologyCircuit Making & Hardware PrototypingCustomizable & Personalized ObjectsUIST
PortaChrome: A Portable Contact Light Source for Integrated Re-Programmable Multi-Color TexturesIn this paper, we present PortaChrome, a portable light source that can be attached to everyday objects to reprogram the color and texture of surfaces that come in contact with them. When PortaChrome makes contact with objects previously coated with photochromic dye, the UV and RGB LEDs inside PortaChrome create multi…2024YZYunyi Zhu et al.Massachusetts Institute of TechnologyShape-Changing Materials & 4D PrintingCustomizable & Personalized ObjectsUIST
EITPose: Wearable and Practical Electrical Impedance Tomography for Continuous Hand Pose EstimationReal-time hand pose estimation has a wide range of applications spanning gaming, robotics, and human-computer interaction. In this paper, we introduce EITPose, a wrist-worn, continuous 3D hand pose estimation approach that uses eight electrodes positioned around the forearm to model its interior impedance distribution…2024AKAlexander Kyu et al.Carnegie Mellon UniversityHaptic WearablesHand Gesture RecognitionFoot & Wrist InteractionCHI
MagKnitic: Machine-knitted Passive and Interactive Haptics Textiles with Integrated Binary SensingIn this paper, we introduce \textit{MagKnitic}, a novel approach to integrate passive force feedback and binary sensing into fabrics via digital machine knitting. Our approach utilizes digital fabrication technology to enable haptic interfaces that are soft, flexible, lightweight, and conform to the user's body shape.…2023YLYiyue Luo et al.Massachusetts Institute of TechnologyHaptic WearablesShape-Changing Interfaces & Soft Robotic MaterialsUIST
MechSense: A Design and Fabrication Pipeline for Integrating Rotary Encoders into 3D Printed MechanismsWe introduce MechSense, 3D-printed rotary encoders that can be fabricated in one pass alongside rotational mechanisms, and report on their angular position, direction of rotation, and speed. MechSense encoders utilize capacitive sensing by integrating a floating capacitor into the rotating element and three capacitive…2023MAMarwa AlAlawi et al.Massachusetts Institute of TechnologyDesktop 3D Printing & Personal FabricationCircuit Making & Hardware PrototypingCHI
FlexBoard: A Flexible Breadboard for Interaction Prototyping on Curved and Deformable SurfacesWe present FlexBoard, an interaction prototyping platform that enables rapid prototyping with interactive components such as sensors, actuators and displays on curved and deformable objects. FlexBoard offers the rapid prototyping capabilities of traditional breadboards but is also flexible to conform to different shap…2023DKDonghyeon Ko et al.Massachusetts Institute of TechnologyShape-Changing Interfaces & Soft Robotic MaterialsDesktop 3D Printing & Personal FabricationCHI
MuscleRehab: Improving Unsupervised Physical Rehabilitation by Monitoring and Visualizing Muscle EngagementUnsupervised physical rehabilitation traditionally has used motion tracking to determine correct exercise execution. However, motion tracking is not representative of the assessment of physical therapists, which focus on muscle engagement. In this paper, we investigate if monitoring and visualizing muscle engagement d…2022JZJunyi Zhu et al.Massachusetts Institute of TechnologySurgical Assistance & Medical TrainingBiosensors & Physiological MonitoringComputational Methods in HCIUIST
EIT-kit: An Electrical Impedance Tomography Toolkit for Health and Motion SensingIn this paper, we propose EIT-kit, an electrical impedance tomography toolkit for designing and fabricating health and motion sensing devices. EIT-kit contains (1) an extension to a 3D editor for personalizing the form factor of electrode arrays and electrode distribution, (2) a customized EIT sensing motherboard for…2021JZJunyi Zhu et al.Massachusetts Institute of TechnologyFitness Tracking & Physical Activity MonitoringBiosensors & Physiological MonitoringUIST
MorphSensor: A 3D Electronic Design Tool for Reforming Sensor ModulesMorphSensor is a 3D electronic design tool that enables designersto morph existing sensor modules of pre-defined twodimensional shape into free-form electronic component arrangements that better integrate with the three-dimensional shape of a physical prototype. MorphSensor builds onto existing sensor module schemat…2020JZJunyi Zhu et al.Massachusetts Institute of TechnologyDesktop 3D Printing & Personal FabricationCircuit Making & Hardware PrototypingUIST
CurveBoards: Integrating Breadboards into Physical Objects to Prototype Function in the Context of FormCurveBoards are breadboards integrated into physical objects. In contrast to traditional breadboards, CurveBoards better preserve the object's look and feel while maintaining high circuit fluidity, which enables designers to exchange and reposition components during design iteration. Since CurveBoards are fully functi…2020JZJunyi Zhu et al.Massachusetts Institute of TechnologyCircuit Making & Hardware PrototypingPrototyping & User TestingCHI
Seismo: Blood Pressure Monitoring using Built-in Smartphone Accelerometer and CameraAlthough cost-effective at-home blood pressure monitors are available, a complementary mobile solution can ease the burden of measuring BP at critical points throughout the day. In this work, we developed and evaluated a smartphone-based BP monitoring application called textit{Seismo}. The technique relies on measuri…2018EWEdward Jay Wang et al.University Of WashingtonSmartwatches & Fitness BandsBiosensors & Physiological MonitoringCHI