The Impact of Sharing Gaze Behaviours in Collaborative Mixed Reality

Video

DOI

In a remote collaboration involving a physical task, visualising gaze behaviours may compensate for other unavailable communication channels. In this paper, we report on a 360° panoramic Mixed Reality (MR) remote collaboration system that shares gaze behaviour visualisations between a local user in Augmented Reality and a remote collaborator in Virtual Reality. We conducted two user studies to evaluate the design of MR gaze interfaces and the effect of gaze behaviour (on/off) and gaze style (bi-/uni-directional). The results indicate that gaze visualisations amplify meaningful joint attention and improve co-presence compared to a no gaze condition. Gaze behaviour visualisations enable communication to be less verbally complex therefore lowering collaborators’ cognitive load while improving mutual understanding. Users felt that bi-directional behaviour visualisation, showing both collaborator’s gaze state, was the preferred condition since it enabled easy identification of shared interests and task progress.