Cheng Zhang

schoolCornell Universitybar_chart#353 Global Rank

Total Papers

HCI Rank

#353

Research Areas

Years Active

Recent Publications

WatchHand: Enabling Continuous Hand Pose Tracking On Off-the-Shelf Smartwatches

Tracking hand poses on wrist-wearables enables rich, expressive interactions, yet remains unavailable on commercial smartwatches, as prior implementations rely on external sensors or custom hardware, limiting their real-world applicability. To address this, we present WatchHand, the first continuous 3D hand pose track…

CSCW '25CorrespondingDeaf and Hard-of-Hearing Research

Exploring the Impact of Emotional Voice Integration in Sign-to-Speech Translators for Deaf-to-Hearing Communication

Emotional voice communication plays a crucial role in effective daily interactions. Deaf and Hard of Hearing (DHH) individuals, who often have limited use of voice, rely on facial expressions to supplement sign language and convey emotions. However, in American Sign Language (ASL), facial expressions serve not only em…

CHI '25CorrespondingFoot & Wrist Interaction +2

SpellRing: Recognizing Continuous Fingerspelling in American Sign Language using a Ring

Fingerspelling is a critical part of American Sign Language (ASL) recognition and has become an accessible optional text entry method for Deaf and Hard of Hearing (DHH) individuals. In this paper, we introduce SpellRing, a single smart ring worn on the thumb that recognizes words continuously fingerspelled in ASL. Spe…

UBICOMP '24CorrespondingHonorable MentionDiet Tracking & Nutrition Management +2

EchoGuide: Active Acoustic Guidance for LLM-Based Eating Event Analysis from Egocentric Videos

Self-recording eating behaviors is a step towards a healthy lifestyle recommended by many health professionals. However, the current practice of manually recording eating activities using paper records or smartphone apps is often unsustainable and inaccurate. Smart glasses have emerged as a promising wearable form fac…

UBICOMP '24CorrespondingDiet Tracking & Nutrition Management +1

MunchSonic: Tracking Fine-grained Dietary Actions through Active Acoustic Sensing on Eyeglasses

We introduce MunchSonic, an AI-powered active acoustic sensing system integrated into eyeglasses to track fine-grained dietary actions. MunchSonic emits inaudible ultrasonic waves from the eyeglass frame, with the reflected signals capturing detailed positions and movements of body parts, including the mouth, jaw, arm…

UIST '24CorrespondingHaptic Wearables +2

SeamPose: Repurposing Seams as Capacitive Sensors in a Shirt for Upper-Body Pose Tracking

Seams are areas of overlapping fabric formed by stitching two or more pieces of fabric together in the cut-and-sew apparel manufacturing process. In SeamPose, we repurposed seams as capacitive sensors in a shirt for continuous upper-body pose estimation. Compared to previous all-textile motion-capturing garments that…

CHI '24CorrespondingHand Gesture Recognition +1

EchoWrist: Continuous Hand Pose Tracking and Hand-Object Interaction Recognition Using Low-Power Active Acoustic Sensing On a Wristband

Our hands serve as a fundamental means of interaction with the world around us. Therefore, understanding hand poses and interaction contexts is critical for human-computer interaction (HCI). We present EchoWrist, a low-power wristband that continuously estimates 3D hand poses and recognizes hand-object interactions us…

CHI '24CorrespondingHand Gesture Recognition +3

EyeEcho: Continuous and Low-power Facial Expression Tracking on Glasses

In this paper, we introduce EyeEcho, a minimally-obtrusive acoustic sensing system designed to enable glasses to continuously monitor facial expressions. It utilizes two pairs of speakers and microphones mounted on glasses, to emit encoded inaudible acoustic signals directed towards the face, capturing subtle skin def…

UBICOMP '23CorrespondingHuman Pose & Activity Recognition +1

PoseSonic: 3D Upper Body Pose Estimation Through Egocentric Acoustic Sensing on Smartglasses

"In this paper, we introduce PoseSonic, an intelligent acoustic sensing solution for smartglasses that estimates upper body poses. Our system only requires two pairs of microphones and speakers on the hinges of the eyeglasses to emit FMCW-encoded inaudible acoustic signals and receive reflected signals for body pose e…

UBICOMP '23CorrespondingPasswords & Authentication +1

C-Auth: Exploring the Feasibility of Using Egocentric View of Face Contour for User Authentication on Glasses

In this paper, we present C-Auth, a novel authentication method for smart glasses that explores the feasibility of authenticating users using spatial facial information. Our system uses a down-facing camera in the middle of the glasses to capture facial contour lines from the nose and cheeks. The images captured by th…

View all 17 papers →

Quick Actions

Share this page

ios_share

X in mail

https://hci.top/en/authors/9937?source=all