Beyond Kant and Bentham: How Ethical Theories are being used in Artificial Moral Agents
Title of the Paper
Beyond Kant and Bentham: How Ethical Theories are being Used in Artificial Moral Agents
Bibliographic Information
- Subject Area: AI ethics, particularly the study of Artificial Moral Agents (AMAs) and the application of ethical theories.
- Keywords: Ethics, philosophy, artificial moral agents, literature review, deontology, consequentialism, virtue ethics, Confucian ethics, indigenous ethics.
Research Background and Issues
- Issues or Challenges:
- How can ethical norms be implemented and encoded in artificial moral agents?
- Is the current development of AMAs limited to certain ethical paradigms, such as deontology and consequentialism?
- Are there cross-cultural and interdisciplinary biases that lead to the neglect of other ethical frameworks?
- Research Significance:
- With the proliferation of autonomous vehicles, eldercare robots, and automated financial systems, it is increasingly critical to ensure that machines can act in morally appropriate ways.
- The current dominance of Western philosophical ethics in machine ethics research may hinder the representation of diverse ethical values on a global scale.
- Motivation and Related Work:
- Previous studies have extensively applied deontology and consequentialism to the field of machine ethics, but there has been limited exploration of other philosophical theories, such as Confucian and indigenous ethics.
- The practical application of AMAs still lacks detailed empirical evidence.
Proposed Solution
-
Proposed Methods or Solutions:
- Conduct a multidisciplinary literature review on the application of ethical theories in AMAs, covering both Western paradigms (e.g., deontology and consequentialism) and non-Western paradigms (e.g., Confucian ethics and indigenous ethics).
- Categorize and analyze existing literature to reveal which ethical theories are most commonly adopted and how they are implemented.
-
Innovative Contributions:
- Moves beyond typical moral decision-making frameworks (e.g., rules and consequences) to explore under-researched areas such as virtue ethics, Confucian ethics, indigenous ethics, and existentialism.
- Highlights the potential role of integrating ethical theories with human-computer interaction (HCI) in designing fair and responsible artificial intelligence.
-
Implementation Steps and Key Techniques:
- Literature Construction: Keywords such as "machine ethics" and related terms were filtered from ACM, IEEE, and reference citations, resulting in the selection of 53 papers for review.
- Methodological Framework: Literature content was categorized and annotated based on specific ethical theories (e.g., deontology, consequentialism, virtue ethics) and research methods (e.g., technical implementation, theoretical analysis, empirical studies).
Research Findings
-
Specific Findings:
- Of the 53 papers, 46 primarily focused on deontology and consequentialism, along with supplementary theories such as the principle of double effect and Ross's ethics. Few papers explored non-Western paradigms (e.g., Confucian ethics, indigenous ethics).
- The study highlights the potential issue of Western ethical centralism in AMA development, which may hinder the application of broader ethical values.
- From an implementation perspective, most academic papers focus on technical implementation and theoretical analysis, with few addressing empirical studies in real-world environments.
-
Comparison with Existing Solutions:
- Most current research is limited to analytical debates or technical proposals, lacking empirical studies to test and validate theories.
- This study points out that over-reliance on deontological/consequentialist frameworks may lead to restrictive AMA development, neglecting the global diversity of ethical perspectives.
-
Experimental or Evaluation Results:
- Some empirical studies found that decision-making models for AMAs based on Western ethical paradigms (e.g., deontology and consequentialism) may face lower public acceptance.
- Paradigms such as Confucian ethics, which emphasize relationships and social roles, can contribute to developing more meaningful human-machine interactions.
-
Limitations and Future Directions:
- Current Limitations:
- The literature is primarily focused on Western contexts, with insufficient in-depth empirical exploration of other philosophical traditions (e.g., existentialism, indigenous ethics).
- The HCI community has yet to fully develop the potential applications of AMAs in real-world social scenarios.
- Future Directions:
- Encourage exploration of non-Western philosophical traditions, particularly the application of Confucian ethics, existentialism, and indigenous perspectives in AMAs.
- Advance empirical research to evaluate how AMAs influence human decision-making and gain social acceptance in practice.
- Develop more relationship-oriented and long-term feedback mechanisms within virtue ethics and moral development frameworks.
- Current Limitations:
Through this study, the authors not only describe and summarize the mainstream ethical frameworks for AMAs but also propose important recommendations for promoting diverse, multicultural research and practice in machine ethics. These insights lay a theoretical foundation for the HCI and AI communities to further develop moral machines that can be effectively integrated into society.
Research Questions / Practical Problems
Question signals indexed for this paper.
Research Questions
3- How can ethical norms be implemented and encoded in artificial moral agents (AMAs)?Category: Responsible Data Practices and Behavior InterventionSimilar questionsarrow_forward
- Is current AMA development overly dependent on Western philosophical paradigms (e.g., deontology and consequentialism)?Category: Responsible Data Practices and Behavior InterventionSimilar questionsarrow_forward
- Does neglect of other ethical frameworks (e.g., Confucian and Indigenous ethics) reflect cultural and interdisciplinary bias?Category: Responsible Data Practices and Behavior InterventionSimilar questionsarrow_forward
Practical Problems
1- AI systems struggle to gain broad global acceptance under diverse ethical frameworks.Category: Responsible Data Practices and Behavior InterventionSimilar questionsarrow_forward
- 83%
“It’s Just a Wild, Wild West”: Harnessing Public Procurement as an AI Governance Mechanism
CHI '26· AI Ethics, Fairness & Accountability +2
- 80%
The General Data Protection Regulation : an opportunity for the HCI Community?
CHI '18· Privacy by Design & User Control +1
- 80%
Assessing MyData Scenarios: Ethics, Concerns, and the Promise
CHI '21· AI Ethics, Fairness & Accountability +1
- 80%
I lose vs. I earn: Consumer perceived price fairness toward algorithmic (vs. human) price discrimination
CHI '24· AI Ethics, Fairness & Accountability +2
- 67%
Relations are more than Bytes: Re-thinking the Benefits of Smart Services through People and Things
CHI '19· AI Ethics, Fairness & Accountability +2
- 67%
Factors Influencing Perceived Fairness in Algorithmic Decision-Making: Algorithm Outcomes, Development Procedures, and Individual Differences
CHI '20· AI Ethics, Fairness & Accountability +1
- 67%
Impact and User Perception of Sandwich Attacks in the DeFi Ecosystem
CHI '22· AI Ethics, Fairness & Accountability +2
- 67%
A Psychometric Scale to Measure Individuals' Value of Other People's Privacy (VOPP)
CHI '23· AI Ethics, Fairness & Accountability +2
- 67%
Disentangling Fairness Perceptions in Algorithmic Decision-Making: the Effects of Explanations, Human Oversight, and Contestability.
CHI '23· AI Ethics, Fairness & Accountability +2
- 60%
Perceptions of Sentient AI and Other Digital Minds: Evidence from the AI, Morality, and Sentience (AIMS) Survey
CHI '25· AI Ethics, Fairness & Accountability +2
Based on Jaccard similarity of research subtopics & professions (≥60%)