Robot, Avatar, or Human: The Impact of Partner Representation and Task on the Communication Experience

Avatars and telepresence robots have long received attention for remote communication. However, the specific nature of their physicality, expressiveness, and mobility may affect their usefulness for different tasks. This work compares using an avatar (presented in augmented reality) and a telepresence robot to Face-to-Face (F2F) communication. We focus on the influence of different communication tasks: free conversation, negotiation, and referential communication with movement. Thus, we conducted a user study (split-plot design, N=54) with the type of representation of the conversational partner as the within variable and the communication task as the between variable. Our results show that type of task, especially referential communication with movement, influenced attention to nonverbal cues and perceived closeness. Generally, gestures and body movements received the least focus with telepresence robots. Gestures in avatars and F2F drew similar attention, attributed to the avatar’s tracking fidelity. Gaze received less attention in both mediums than F2F, while facial expressions on the robot’s screen heightened attention compared to avatars. These findings advance the fundamental understanding of mediated communication and support researchers and practitioners in shaping the design of communication applications beyond today’s video calls.