HCI.TOPHCI, made easy

arrow_backBack to questions View categoryarrow_forward

Sensing, Recognition, and Security / Robot Co-Gesture and Multimodal Gesture Interaction

Current shape-changing interfaces struggle to dynamically adjust 3D shapes according to user needs.

lightbulbPractical problemRobot Co-Gesture and Multimodal Gesture Interaction

Current shape-changing interfaces struggle to dynamically adjust 3D shapes according to user needs.

UIST '24Towards Multimodal Interaction with AI-Infused Shape-Changing Interfaces

Similar questions

lightbulbPractical problemRobot Co-Gesture and Multimodal Gesture Interaction

Open offices disrupt employee focus and privacy, reducing job satisfaction.

CHI '25Manifesting Architectural Subspaces with Two Mobile Robotic Partitions to Facilitate Spontaneous Office Meetings

lightbulbPractical problemRobot Co-Gesture and Multimodal Gesture Interaction

Users lack natural nonverbal communication when interacting with robots.

CHI '25User-defined Co-speech Gesture Design with Swarm Robots

lightbulbPractical problemRobot Co-Gesture and Multimodal Gesture Interaction

Users struggle to flexibly manage complex dialogue tasks, and traditional voice interfaces are inefficient.

CHI '25Gesture and Audio-Haptic Guidance Techniques to Direct Conversations with Intelligent Voice Interfaces

lightbulbPractical problemRobot Co-Gesture and Multimodal Gesture Interaction

Presenters struggle to control complex animations in real time while maintaining consistency between speech and gestures.

CHI '24Elastica: Adaptive Live Augmented Presentations with Elastic Mappings Across Modalities

lightbulbPractical problemRobot Co-Gesture and Multimodal Gesture Interaction

Virtual teaching agents in existing educational technology lack semantic-level gesture–speech synchronization.

CSCW '23When Gestures and Words Synchronize: Exploring A Human Lecturer’s Multimodal Interaction toward the Design of Embodied Pedagogical Agents

lightbulbPractical problemRobot Co-Gesture and Multimodal Gesture Interaction

Tutorial video creators lack flexible, low-disruption tools for dynamic filming.

CHI '23Stargazer: An Interactive Camera Robot for Capturing How-To Videos Based on Subtle Instructor Cues

Related papers

Manifesting Architectural Subspaces with Two Mobile Robotic Partitions to Facilitate Spontaneous Office Meetings

Ozan Balcı, Stien Poncelet, Alex Binh Vinh Duc Nguyen

User-defined Co-speech Gesture Design with Swarm Robots

Minh Duc Dang, Samira Pulatova, Lawrence H Kim

Gesture and Audio-Haptic Guidance Techniques to Direct Conversations with Intelligent Voice Interfaces

Shwetha Rajaram, Hemant Bhaskar Surale, Codie McConkey

Elastica: Adaptive Live Augmented Presentations with Elastic Mappings Across Modalities

Yining Cao, Rubaiat Habib Kazi, Li-Yi Wei

Stargazer: An Interactive Camera Robot for Capturing How-To Videos Based on Subtle Instructor Cues

Jiannan Li, Mauricio Sousa, Karthik Mahadevan

I Need a Third Arm! Eliciting Body-based Interactions with a Wearable Robotic Arm

Marie Muehlhaus, Marion Koelle, Artin Saberpour Abadian

Corsetto: A Kinesthetic Garment for Designing, Composing for, and Experiencing an Intersubjective Haptic Voice

Ozgun Kilic Afsar, Yoav Luft, Kelsey Cotton

Show of Hands: Leveraging Hand Gestural Cues in Virtual Meetings for Intelligent Impromptu Polling Interactions

Jung In Koh, Samantha Ray, Josh Cherian

Augmented Chironomia for Presenting Data to Remote Audiences

Brian D. Hall, Lyn Bartram, Matthew Brehmer

Embodied Geometric Reasoning with a Robot: The Impact of Robot Gestures on Student Reasoning about Geometrical Conjectures

Joseph E Michaelis, Daniela Di Canio

SGToolkit: An Interactive Gesture Authoring Toolkit for Embodied Conversational Agents

Youngwoo Yoon, Keunwoo Park, Minsu Jang

Communication Skills Training Intervention Based on Automated Recognition of Nonverbal Signals

Monica Pereira, Kate Hone