Sensory Alignment in Immersive Entertainment
Authors
When we use digital systems to stimulate the senses, we typically stimulate only a subset of users' senses, leaving other senses stimulated by the physical world. This creates potential for misalignment between senses, where digital and physical stimulation give conflicting signals to users. We synthesize knowledge from HCI, traditional entertainments, and underlying sensory science research relating to how senses work when given conflicting signals. Using this knowledge we present a design dimension of sensory alignment, and show how this dimension presents opportunities for a range of creative strategies ranging from full alignment of sensory stimulation, up to extreme conflict between senses.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 67%
Mixed Reality Remote Collaboration Combining 360 Video and 3D Reconstruction
CHI '19· Social & Collaborative VR +1
- 67%
Improving Humans' Ability to Interpret Deictic Gestures in Virtual Reality
CHI '20· Social & Collaborative VR +1
- 67%
Phonetroller: Visual Representations of Fingers for Precise Touch Input when using a Phone in VR
CHI '21· Social & Collaborative VR +1
- 67%
SkyPort: Investigating 3D Teleportation Methods in Virtual Environments
CHI '22· Social & Collaborative VR +1
- 67%
Digital Proxemics: Designing Social and Collaborative Interaction in Virtual Environments
CHI '22· Social & Collaborative VR +1
- 67%
Going, Going, Gone: Exploring Intention Communication for Multi-User Locomotion in Virtual Reality
CHI '23· Social & Collaborative VR +1
- 67%
Re-Evaluating VR User Awareness Needs During Bystander Interactions
CHI '23· Social & Collaborative VR +1
- 67%
Exploring Experience Gaps Between Active and Passive Users During Multi-user Locomotion in VR
CHI '24· Social & Collaborative VR +1
- 67%
Disembodied, Asocial, and Unreal: How Users (Re)Interpret Designed Affordances of Social VR
DIS '24· Social & Collaborative VR +1
- 67%
Increasing Walking in VR using Redirected Teleportation
UIST '18· Social & Collaborative VR +1
Based on Jaccard similarity of research subtopics & professions (≥60%)