“Hello, This is a Voice Assistant Calling" When a Human Voice Calls Claiming to Be a Machine on an Ordinary Day
Authors
With the advent of neural networks, it has become possible to generate synthetic voices that are nearly indistinguishable from real human speech (i.e., human-sounding voice). In contrast, earlier voice assistants used voices that were instantly recognizable as machine-generated, owing to their standardized, consistent, and highly intelligible qualities (i.e., artificial-sounding voice). Although people tend to prefer human-like voices, adopting human-sounding voices in voice assistants raises ethical concerns related to confusion or unintentional deception, particularly in voice-only contexts, even when their identity as systems is explicitly disclosed. To explore the voice design direction for future voice assistants, we examined how participants perceived and interacted when they were unexpectedly confronted with either an artificial-sounding or a human-sounding voice, both of which clearly identified themselves as voice assistants, through an everyday phone call. Our findings reveal participants’ experiences and conversational behaviors in each voice condition. Furthermore, we discuss how the voices of voice assistants should be designed and propose implications that emphasize transparent and responsive voices.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 100%
Emotional Dialogue Generation Using Image-Grounded Language Models
CHI '18· Intelligent Voice Assistants (Alexa, Siri, etc.) +1
- 100%
Understanding Affective Experiences with Conversational Agents
CHI '19· Intelligent Voice Assistants (Alexa, Siri, etc.) +1
- 100%
A New Uncanny Valley? The Effects of Speech Fidelity and Human Listener Gender on Social Perceptions of a Virtual-Human Speaker
CHI '22· Intelligent Voice Assistants (Alexa, Siri, etc.) +1
- 100%
Simulating Human Imprecision in Temporal Statements of Intelligent Virtual Agents
CHI '22· Intelligent Voice Assistants (Alexa, Siri, etc.) +1
- 100%
Super Kawaii Vocalics: Amplifying the “Cute” Factor in Computer Voice
CHI '25· Intelligent Voice Assistants (Alexa, Siri, etc.) +1
- 100%
Exploring Humor as a Repair Strategy During Communication Breakdowns with Voice Assistants
CUI '23· Intelligent Voice Assistants (Alexa, Siri, etc.) +1
- 100%
Typing Behavior is About More than Speed: Users' Strategies for Choosing Word Suggestions Despite Slower Typing Rates
MobileHCI '23· Intelligent Voice Assistants (Alexa, Siri, etc.) +1
- 100%
Agent-based Mediation on Smartphone Usage among Co-located Couples
MobileHCI '24· Intelligent Voice Assistants (Alexa, Siri, etc.) +1
- 67%
Implicit Communication of Actionable Information in Human-AI teams
CHI '19· Intelligent Voice Assistants (Alexa, Siri, etc.) +2
- 67%
What Do We See in Them? Identifying Dimensions of Partner Models for Speech Interfaces Using a Psycholexical Approach
CHI '21· Voice User Interface (VUI) Design +2
Based on Jaccard similarity of research subtopics & professions (≥60%)