Hui-Shyong Yeo

schoolMicrosoftbar_chart#1191 Global Rank

Total Papers

HCI Rank

#1191

Research Areas

Years Active

Recent Publications

MicroCam: Leveraging Smartphone Microscope Camera for Context-Aware Contact Surface Sensing

"The primary focus of this research is the discreet and subtle everyday contact interactions between mobile phones and their surrounding surfaces. Such interactions are anticipated to facilitate mobile context awareness, encompassing aspects such as dispensing medication updates, intelligently switching modes (e.g., s…

CHI '231st AuthorEye Tracking & Gaze Interaction +2

OmniSense: Exploring Novel Input Sensing and Interaction Techniques on Mobile Device with an Omni-Directional Camera

An omni-directional (360°) camera captures the entire viewing sphere surrounding its optical center. Such cameras are growing in use to create highly immersive content and viewing experiences. When such a camera is held by a user, the view includes the user's hand grip, finger, body pose, face, and the surrounding env…

UIST '203rd AuthorHand Gesture Recognition +1

Back-Hand-Pose: 3D Hand Pose Estimation for a Wrist-worn Camera via Dorsum Deformation Network

The automatic recognition of how people use their hands and fingers in natural settings – without instrumenting the fngers – can be useful for many mobile computing applications. To achieve such an interface, we propose a vision-based 3D hand pose estimation framework using a wrist-worn camera. The main challenge is t…

CHI '201st AuthorIn-Vehicle Haptic, Audio & Multimodal Feedback +1

WATouCH: Enabling Direct Input on Non-touchscreen Using Smartwatch's Photoplethysmogram and IMU Sensor Fusion

Interacting with non-touchscreens such as TV or public displays can be difficult and inefficient. We propose WATouCH, a novel method that localizes a smartwatch on a display and allows direct input by turning the smartwatch into a tangible controller. This low-cost solution leverages sensor fusion of the built-in iner…

UIST '191st AuthorFoot & Wrist Interaction +1

Opisthenar: Hand Poses and Finger Tapping Recognition by Observing Back of Hand Using Embedded Wrist Camera

We introduce a vision-based technique to recognize hand poses and gestures by simply observing changes on the back of the hand. Our approach employs a camera on the wrist, which we envisage can be included in a wrist-worn device such as a smartwatch, fitness tracker or wristband. However, in this configuration the fi…

CHI '193rd AuthorFoot & Wrist Interaction +1

RotoSwype: Word-Gesture Typing using a Ring

We propose RotoSwype, a technique for word-gesture typing using the orientation of a ring worn on the index finger. RotoSwype enables one-handed text-input without encumbering the hand with a device, a desirable quality in many scenarios, including virtual or augmented reality. The method is evaluated using two arm po…

CHI '185th+ AuthorMixed Reality Workspaces +1

AdaM: Adapting Multi-User Interfaces for Collaborative Environments in Real-Time

Developing cross-device multi-user interfaces (UIs) is a challenging problem. There are numerous ways in which content and interactivity can be distributed. However, good solutions must consider multiple users, their roles, their preferences and access rights, as well as device capabilities. Manual and rule-based solu…

CHI '185th+ AuthorBest PaperShape-Changing Interfaces & Soft Robotic Materials +2

Project Zanzibar: A Portable and Flexible Tangible Interaction Platform

We present Project Zanzibar: a flexible mat that can locate, uniquely identify and communicate with tangible objects placed on its surface, as well as sense a user's touch and hover hand gestures. We describe the underlying technical contributions: efficient and localised Near Field Communication (NFC) over a larg…

Quick Actions

Share this page

ios_share

X in mail

https://hci.top/en/authors/1650?source=all