Don't Be Alarmed: Sonifying Autonomous Vehicle Perception to Increase Situation Awareness
Authors
Lack of trust can arise when people do not know what autonomous vehicles perceive in the environment. To convey this information without causing alarm or compelling people to act, we designed and evaluated a way to sonify an autonomous vehicle's perception of salient driving events using abstract auditory icons, or "earcons." These are localized in space using an in-car quadraphonic speaker array to correspond with the direction of events. We describe the interaction design for these awareness cues and a validation experiment (\textit{N}=28) examining the effects of sonified events on drivers' sense of situation awareness, comfort, and trust. Overall, this work suggests that our designed earcons do improve people's awareness of in-simulation events. The effect of the increased situational awareness on trust and comfort is inconclusive. However, post-study design feedback suggests that sounds should have low levels of intensity and dissonance, and a sense of belonging to a common family.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 80%
In UX We Trust: Investigation of Aesthetics and Usability of Driver-Vehicle Interfaces and Their Impact on the Perception of Automated Driving
CHI '19· Automated Driving Interface & Takeover Design +2
- 75%
Reducing the Attentional Demands of In-Vehicle Touchscreens with Stencil Overlays
AutoUI '18· In-Vehicle Haptic, Audio & Multimodal Feedback
- 75%
The Effect of Road Bumps on Touch Interaction in Cars
AutoUI '18· In-Vehicle Haptic, Audio & Multimodal Feedback
- 67%
Investigating Car Drivers’ Information Demand after Safety and Security Critical Incidents
CHI '21· Head-Up Display (HUD) & Advanced Driver Assistance Systems (ADAS) +2
- 60%
Haptic Navigation Cues on the Steering Wheel
CHI '19· In-Vehicle Haptic, Audio & Multimodal Feedback +1
- 60%
Chase Lights in the Peripheral View: How the Design of Moving Patterns on an LED Strip Influences the Perception of Speed in an Automotive Context
CHI '20· Head-Up Display (HUD) & Advanced Driver Assistance Systems (ADAS) +1
- 60%
Voice+Tactile: Augmenting In-vehicle Voice User Interface with Tactile Touchpad Interaction
CHI '20· In-Vehicle Haptic, Audio & Multimodal Feedback +1
- 60%
Non-Verbal Auditory Input for Controlling Binary, Discrete, and Continuous Input in Automotive User Interfaces
CHI '20· In-Vehicle Haptic, Audio & Multimodal Feedback +1
- 60%
Effects of Semantic Segmentation Visualization on Trust, Situation Awareness, and Cognitive Load in Highly Automated Vehicles
CHI '21· Head-Up Display (HUD) & Advanced Driver Assistance Systems (ADAS) +1
- 60%
In-vehicle Performance and Distraction for Midair and Touch Directional Gestures
CHI '23· In-Vehicle Haptic, Audio & Multimodal Feedback +1
Based on Jaccard similarity of research subtopics & professions (≥60%)