Robert Wang

schoolMetabar_chart#3554 Global Rank

Total Papers

HCI Rank

#3554

Research Areas

Years Active

Recent Publications

StegoType: Surface Typing from Egocentric Cameras

Text input is a critical component of any general purpose computing system, yet efficient and natural text input remains a challenge in AR and VR. Headset based hand-tracking has recently become pervasive among consumer VR devices and affords the opportunity to enable touch typing on virtual keyboards. We present an a…

UIST '245th+ AuthorMixed Reality Workspaces +2

TouchInsight: Uncertainty-aware Rapid Touch and Text Input for Mixed Reality from Egocentric Vision

While passive surfaces offer numerous benefits for interaction in mixed reality, reliably detecting touch input solely from head-mounted cameras has been a long-standing challenge. Camera specifics, hand self-occlusion, and rapid movements of both head and fingers introduce considerable uncertainty about the exact loc…

CHI '245th+ AuthorHand Gesture Recognition +1

STMG: A Machine Learning Microgesture Recognition System for Supporting Thumb-Based VR/AR Input

AR/VR devices have started to adopt hand tracking, in lieu of controllers, to support user interaction. However, today's hand input rely primarily on one gesture: pinch. Moreover, current mappings of hand motion to use cases like VR locomotion and content scrolling involve more complex and larger arm motions than joys…

UIST '20CorrespondingHand Gesture Recognition +1

Decoding Surface Touch Typing from Hand-Tracking

We propose a novel text decoding method that enables touch typing on an uninstrumented flat surface. Rather than relying on physical keyboards or capacitive touch, our method takes as input hand motion of the typist, obtained through hand-tracking, and decodes this motion directly into text. We use a temporal convolut…

Quick Actions

Share this page

ios_share

X in mail

https://hci.top/en/authors/11285?source=all