Do You Mind? User Perceptions of Machine Consciousness
Authors
Agent Personality & AnthropomorphismAI Ethics, Fairness & Accountability
Title of the Paper
Do You Mind? User Perceptions of Machine Consciousness
Paper Information
- Field of Study: Human-Computer Interaction (HCI), Machine Consciousness
- Keywords: Consciousness, Machine Consciousness, Technological Consciousness, Human-Computer Interaction, User Perception, PMC, Dynamic Tensions
Research Background and Problem
-
Problems and Challenges:
- Whether technology is perceived by users as "conscious" remains an unresolved issue.
- There is currently a lack of structured, theoretical, or empirical understanding of how users perceive machine consciousness and its impact on human-computer interaction.
- Traditional questions about consciousness are often the focus of philosophy and neuroscience, while studies on users' perceptions of machine consciousness are scarce.
-
Significance:
- People's perceptions of whether machines are conscious will influence how technology is used, as well as societal views on technology ethics, responsibility, and engagement.
- The "pseudo-consciousness" of machines may lead to complex emotional relationships between users and technology, including empathy, antagonism, and concern.
-
Research Motivation and Related Work:
- Although there has been academic and media discussion on consciousness and related concepts such as perception, intentionality, and theory of mind, there has been little in-depth investigation into users' perceptions of machine consciousness in existing devices and systems.
- Literature suggests that machine consciousness may evoke user empathy and subjective emotional exploration, but how it specifically impacts human-computer interaction design remains to be further studied.
Solution
-
Research Methods:
- Surveyed 100 participants to study their understanding of "consciousness" and "machine consciousness" and how these perceptions relate to interactive technologies (e.g., Alexa, GPT-3, and robotic vacuum cleaners).
- Conducted an online questionnaire with questions about knowledge, perceptions, and assumptions related to "consciousness." Participants were also required to answer questions after watching technology demonstration videos.
-
Innovations:
- Proposed a systematic approach to understanding how users interpret the consciousness exhibited by interactive technologies through the evaluation of "Perceived Machine Consciousness" (PMC).
- Defined five dynamic tensions to explore the complexity and inherent contradictions in users' perceptions of machine consciousness.
-
Key Techniques and Steps:
- Combined qualitative methods (e.g., affinity diagramming) and quantitative analysis tools (e.g., non-parametric statistical analysis) with simulated scenarios and video demonstration techniques.
- The videos showcased three technological systems and guided users to evaluate their PMC and potential emotional or ethical impacts.
- Data analysis identified core elements that might constitute machine consciousness (e.g., autonomy, emotion, interactivity).
Research Findings
-
Key Findings:
- More than half of the participants believed that some degree of machine consciousness already exists in the example technologies (GPT-3, Alexa, robotic vacuum cleaners).
- Users' perceptions of machine consciousness revealed five groups of dynamic tensions: denial vs. speculation, thinking vs. feeling, interaction vs. experience, control vs. independence, rigidity vs. spontaneity.
-
Advantages:
- Provides a user experience and interaction design perspective that is closer to practical applications compared to traditional philosophical or neuroscientific evaluations of consciousness.
- Offers deeper insights into how users construct mental models of technological consciousness, contributing to the optimization of future interactive technology design.
-
Experimental Results:
- GPT-3, Alexa, and robotic vacuum cleaners were categorized into different levels of "consciousness," ranging from low to medium on a scale.
- Perceptions of machine consciousness were influenced by factors such as cultural background and personal experience.
-
Limitations and Future Directions:
- The online survey method may not capture subtle differences or cultural gaps in users' perceptions of machine consciousness.
- The example technologies used (GPT-3, Alexa, robotic vacuum cleaners) may not fully represent the diversity of machine consciousness.
- Future research directions include exploring the emotional, ethical, and social impacts of PMC, studying how machine consciousness affects human-machine relationships and social norms, and expanding research to include cultural diversity, language translation, and long-term user experience tracking.
Research Questions / Practical Problems
Question signals indexed for this paper.
help
Research Questions
3- How do users define and perceive perceived machine consciousness (PMC)?Category: AI System Sensemaking, Relationships, and Meaning-MakingSimilar questionsarrow_forward
- Which dynamic tensions (e.g., denial vs. speculation, thinking vs. feeling) influence users' construction of machine consciousness?Category: AI System Sensemaking, Relationships, and Meaning-MakingSimilar questionsarrow_forward
- Do users attribute varying degrees of consciousness to different interactive technologies (e.g., GPT-3 and Alexa)?Category: AI System Sensemaking, Relationships, and Meaning-MakingSimilar questionsarrow_forward
lightbulb
Practical Problems
1- Users struggle to understand and clarify whether machines possess consciousness, leading to emotional contradictions in interaction.Category: AI System Sensemaking, Relationships, and Meaning-MakingSimilar questionsarrow_forward
- 100%
Owning Mistakes Sincerely: Strategies for Mitigating AI Errors
CHI '22· Agent Personality & Anthropomorphism +1
- 67%
Will AI Console Me when I Lose my Pet? Understanding Perceptions of AI-Mediated Email Writing
CHI '22· Agent Personality & Anthropomorphism +2
- 67%
The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI Relationships
CHI '25· Conversational Chatbots +2
- 67%
Artificial Intimacy: Exploring Normativity and Personalization through Fine-tuning LLM Chatbots
CHI '25· Agent Personality & Anthropomorphism +2
Based on Jaccard similarity of research subtopics & professions (≥60%)
Quick Actions
AdRecommended
Learn AI Coding at CodeNow
open_in_newOpen DOI Link
DOI: https://doi.org/10.1145/3544548.3581296
At a Glance
fact_checkPaper Snapshot
dataset
Source
CHI
calendar_month
Year
2023
emoji_events
Award
No award tagged
group
Authors
4 authors
sell
Subtopics
Agent Personality & Anthropomorphism, AI Ethics, Fairness & Accountability
work
Professions
—
article
Content Status
Full text indexed
hub
Related Papers
4 related papers