Jingyu Shi

schoolPurdue Universitybar_chart#1287 Global Rank

Total Papers

HCI Rank

#1287

Research Areas

Years Active

Recent Publications

Canvas3D: Empowering Precise Spatial Control for Image Generation with Constraints from a 3D Virtual Canvas

Generative AI (GenAI) has significantly advanced the ease and flexibility of image creation. However, it remains a challenge to precisely control spatial compositions, including object arrangement and scene conditions. To bridge this gap, we propose Canvas3D, an interactive system leveraging a 3D engine to enable prec…

UIST '255th+ AuthorAR Navigation & Context Awareness +2

agentAR: Creating Augmented Reality Applications with Tool-Augmented LLM-based Autonomous Agents

Creating Augmented Reality (AR) applications requires expertise in both design and implementation, posing significant barriers to entry for non-expert users. While existing methods reduce some of this burden, they often fall short in flexibility or usability for complex or varied use cases. To address this, we introdu…

DIS '255th+ AuthorGenerative AI (Text, Image, Music, Video) +2

DesignFromX:Empowering Consumer-Driven Design Space Exploration through Feature Composition of Referenced Products

Industrial products are designed to satisfy the needs of consumers. The rise of generative artificial intelligence (GenAI) enables consumers to easily modify a product by prompting a generative model, opening up opportunities to incorporate consumers in exploring the product design space. However, consumers often st…

CHI '251st AuthorAR Navigation & Context Awareness +2

CARING-AI: Towards Authoring Context-aware Augmented Reality INstruction through Generative Artificial Intelligence

Context-aware AR instruction enables adaptive and in-situ learning experiences. However, hardware limitations and expertise requirements constrain the creation of such instructions. With recent developments in Generative Artificial Intelligence (Gen-AI), current research tries to tackle these constraints by deploying…

CHI '253rd AuthorAR Navigation & Context Awareness +1

Transparent Barriers: Natural Language Access Control Policies for XR-Enhanced Everyday Objects

Extended Reality (XR)-enabled headsets that overlay digital content onto the physical world, are gradually finding their way into our daily life. This integration raises significant concerns about privacy and access control, especially in shared spaces where XR applications interact with everyday objects. Such issues…

UIST '243rd AuthorFull-Body Interaction & Embodied Input +2

avaTTAR: Table Tennis Stroke Training with On-body and Detached Visualization in Augmented Reality

Table tennis stroke training is a critical aspect of player development. We designed a new augmented reality (AR) system, avaTTAR, for table tennis stroke training. The system provides both “on-body” (first-person view) and “detached” (third-person view) visual cues, enabling users to visualize target strokes and cor…

UIST '232nd AuthorFull-Body Interaction & Embodied Input +2

Ubi-TOUCH: Ubiquitous Tangible Object Utilization through Consistent Hand-object interaction in Augmented Reality

Utilizing everyday objects as tangible proxies for Augmented Reality (AR) provides users with haptic feedback while interacting with virtual objects. Yet, existing methods focus on the attributes of the objects, constraining the possible proxies and yielding inconsistency in user experience. Therefore, we propose Ubi-…

CHI '233rd AuthorShape-Changing Interfaces & Soft Robotic Materials +1

Ubi Edge: Authoring Edge-Based Opportunistic Tangible User Interfaces in Augmented Reality

Edges are one of the most ubiquitous geometric features of physical objects. They provide accurate haptic feedback and easy-to-track features for camera systems, making them an ideal basis for Tangible User Interfaces (TUI) in Augmented Reality (AR). We introduce Ubi Edge, an AR authoring tool that allows end-users to…

Quick Actions

Share this page

ios_share

X in mail

https://hci.top/en/authors/9514?source=all