Exploring the Design Space of Extra-Linguistic Expression for Robots
In this paper, we explore the new design space of extra-linguistic cues inspired by graphical tropes used in graphic novels and animation to enhance the expressiveness of social robots. To achieve this, we identified a set of cues that can be used to generate expressions, including smoke/steam/fog, water droplets, and bubbles. We prototyped devices that can generate these fluid expressions for a robot and conducted design sessions where eight designers explored the use and utility of the cues in conveying the robot's internal states in various design scenarios. Our analysis of the 22 designs, the associated design justifications, and the interviews with designers revealed patterns in how each cue was used, how they were combined with nonverbal cues, and where the participants drew their inspiration from. These findings informed the design of an integrated module called EmoPack, which can be used to augment the expressive capabilities of any robot platform.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 75%
Morphees+: Studying Everyday Reconfigurable Objects for the Design and Taxonomy of Reconfigurable UIs
CHI '18· Shape-Changing Interfaces & Soft Robotic Materials
- 75%
Squish This: Force Input on Soft Surfaces for Visual Targeting Tasks
CHI '21· Shape-Changing Interfaces & Soft Robotic Materials
- 60%
PickCells: A Physically Reconfigurable Cell-composed Touchscreen
CHI '19· Shape-Changing Interfaces & Soft Robotic Materials +1
- 60%
transTexture Lamp: Understanding Lived Experiences with Deformation Through a Materiality Lens
CHI '20· Shape-Changing Interfaces & Soft Robotic Materials
- 60%
I am Not an Object: Reframing 3D Body Scanning for Co-Design
CHI '20· Shape-Changing Interfaces & Soft Robotic Materials +1
- 60%
WallTokens: Surface Tangibles for Vertical Displays
CHI '21· Shape-Changing Interfaces & Soft Robotic Materials +1
- 60%
STRAIDE: A Research Platform for Shape-Changing Spatial Displays based on Actuated Strings
CHI '22· Shape-Changing Interfaces & Soft Robotic Materials +1
- 60%
Ubi Edge: Authoring Edge-Based Opportunistic Tangible User Interfaces in Augmented Reality
CHI '23· Shape-Changing Interfaces & Soft Robotic Materials +1
- 60%
Flat Panel Haptics: Embedded Electroosmotic Pumps for Scalable Shape Displays
CHI '23· Shape-Changing Interfaces & Soft Robotic Materials
- 60%
Evaluating Across-Hinge Dragging with Pen and Touch on Curved and Foldable Displays
CHI '23· Shape-Changing Interfaces & Soft Robotic Materials +1
Based on Jaccard similarity of research subtopics & professions (≥60%)