Yingtian Shi

schoolTsinghua Universitybar_chart#4479 Global Rank

Total Papers

HCI Rank

#4479

Research Areas

Years Active

Recent Publications

ReactGenie: A Development Framework for Complex Multimodal Interactions Using Large Language Models

By combining voice and touch interactions, multimodal interfaces can surpass the efficiency of either modality alone. Traditional multimodal frameworks require laborious developer work to support rich multimodal commands where the user’s multimodal command involves possibly exponential combinations of actions/function…

CHI '213rd AuthorHand Gesture Recognition +1

FaceSight: Enabling Hand-to-Face Gesture Interaction on AR Glasses with a Downward-Facing Camera Vision

We present FaceSight, a computer vision-based hand-to-face gesture sensing technique for AR glasses. FaceSight fixes an infrared camera onto the bridge of AR glasses to provide extra sensing capability of the lower face and hand behaviors. We obtained 21 hand-to-face gestures and demonstrated the potential interaction…

UIST '193rd AuthorEye Tracking & Gaze Interaction +2

PrivateTalk: Activating Voice Input with Hand-On-Mouth Gesture Detected by Bluetooth Earphones

We introduce PrivateTalk, an on-body interaction technique to activate voice input with the Hand-On-Mouth gesture. When "talking" to a computing device (e.g., a smartphone), a user covers his/her mouth with the hand from one side. PrivateTalk provides two essential benefits for voice input simultaneously. First, the H…

Quick Actions

Share this page

ios_share

X in mail

https://hci.top/en/authors/6151?source=all