Fengming He

schoolPurdue Universitybar_chart#1609 Global Rank

Total Papers

HCI Rank

#1609

Research Areas

Years Active

Recent Publications

GesPrompt: Leveraging Co-Speech Gestures to Augment LLM-Based Interaction in Virtual Reality

Large Language Model (LLM)-based copilots have shown great potential in Extended Reality (XR) applications. However, the user faces challenges when describing the 3D environments to the copilots due to the complexity of conveying spatial-temporal information through text or speech alone. To address this, we introduce…

CHI '231st AuthorShape-Changing Interfaces & Soft Robotic Materials +1

Ubi Edge: Authoring Edge-Based Opportunistic Tangible User Interfaces in Augmented Reality

Edges are one of the most ubiquitous geometric features of physical objects. They provide accurate haptic feedback and easy-to-track features for camera systems, making them an ideal basis for Tangible User Interfaces (TUI) in Augmented Reality (AR). We introduce Ubi Edge, an AR authoring tool that allows end-users to…

UIST '222nd AuthorHand Gesture Recognition +3

ARnnotate: An Augmented Reality Interface for Collecting Custom Dataset of 3D Hand-Object Interaction Pose Estimation

Vision-based 3D pose estimation has substantial potential in hand-object interaction applications and requires user-specified datasets to achieve robust performance. We propose ARnnotate, an Augmented Reality (AR) interface enabling end-users to create custom data using a hand-tracking-capable AR device. Unlike other…

CHI '222nd AuthorAR Navigation & Context Awareness +1

ScalAR: Authoring Semantically Adaptive Augmented Reality Experiences in Virtual Reality

Augmented Reality (AR) experiences tightly associate virtual contents with environmental entities. However, the dissimilarity of different environments limits the adaptive AR content behaviors under large-scale deployment. We propose ScalAR, an integrated workflow enabling designers to author semantically adaptive AR…

UIST '213rd AuthorHonorable MentionHand Gesture Recognition +1

GesturAR: An Authoring System for Creating Freehand Interactive Augmented Reality Applications

The freehand gesture is an essential input modality for modern Augmented Reality (AR) user experiences. However, developing AR applications with customized hand interactions remains a challenge for end-users. Therefore, we propose GesturAR, an end-to-end authoring tool that supports users to create in-situ freehand AR…

DIS '213rd AuthorAR Navigation & Context Awareness +2

ProcessAR: An Augmented Reality-Based Tool to Create In-Situ Procedural 2D/3D AR Instructions

Augmented reality (AR) is an efficient form of delivering spatial information and has great potential for training workers. However, AR is still not widely used for such scenarios due to the technical skills and expertise required to create interactive AR content. We developed ProcessAR, an AR-based system to develop…

UIST '203rd AuthorHuman Pose & Activity Recognition +2

CAPturAR: An Augmented Reality Tool for Authoring Human-Involved Context-Aware Applications

Recognition of human behavior plays an important role in context-aware applications. However, it is still a challenge for end-users to build personalized applications that accurately recognize their own activities. Therefore, we present CAPturAR, an in-situ programming tool that supports users to rapidly author contex…

Quick Actions

Share this page

ios_share

X in mail

https://hci.top/en/authors/8929?source=all