"Why do we do this?": Moral Stress and the Affective Experience of Ethics in Practice

Research Background and Problem Statement

What issues or challenges did the authors identify?

The paper reveals the difficulties many technical teams face when attempting to integrate ethical tools (e.g., checklists, toolkits, and workshops) into their daily practices. These tools are introduced to bridge the gap between artificial intelligence (AI) ethics principles and practical operations. However, the authors found that the implementation of these tools can lead to unintended consequences: they blur the responsibilities, roles, and boundaries of team members, resulting in emotional discomfort and vulnerability. These issues have not been adequately considered in the design of ethical tools.

Why is this issue important?

The rapid development of AI technologies has sparked widespread ethical concerns, which are closely tied to societal and market dynamics as well as the daily practices of technical professionals. While there has been extensive research on ethical principles, significant obstacles remain in effectively translating these principles into the technical production process. Understanding the emotional aspects of moral stress is crucial for addressing these challenges, as unaddressed stress may lead technical teams to avoid engaging with ethical issues altogether.

Research Motivation and Related Work

• Previous research has primarily focused on how to translate ethical principles into operational methods, but there has been little study on the long-term impact of implementing ethical tools on technical team members.
• Literature suggests that ethical tools often lack influence in organizational adoption, frequently overlooking the complexity of team environments and the feelings of technical professionals.
• The authors explore the emotional experience of ethical practice through the concept of "moral stress," arguing that this emotional dimension is a critical factor limiting the successful implementation of ethical tools.

Proposed Solution

What methods or solutions do the authors propose?

Through a field study of a technical team in a European city within the field of Human-Computer Interaction (HCI), the authors analyze the emotional and organizational impacts of implementing ethical tools. They propose using the concept of "moral stress" as an analytical framework to understand the emotional experiences of technical teams.

What is innovative about this solution?

• It focuses on the emotional and psychological stress associated with ethical practices, moving beyond the traditional focus on the effectiveness of ethical frameworks and tools.
• It employs an ethnographic study method to deeply explore the long-term impacts of implementing ethical tools, rather than merely evaluating the tools themselves.
• It examines how internal team dynamics, organizational structures, and broader societal environments influence the implementation of ethical tools and the resulting moral stress.

What are the implementation steps and key techniques used?

1. Ethnographic Study Design: The authors embedded themselves within the technical team, directly participating in their projects, including observing workshops designed to guide ethical decision-making.
2. Data Collection: They conducted interviews, observed team meetings, and documented workflows to track the team over an extended period.
3. Theoretical Analysis: Using the concept of "moral stress" as an analytical framework, they explored the team's emotional experiences of ethical practices across different relational levels (within the team, within the organization, and external to the organization).
4. Case Study Analysis: They presented specific examples, such as a project on accessible route planning, to illustrate how the team confronted ethical challenges and their emotional responses.

Research Findings

What specific findings were obtained?

1. Revealing the Impact of Ethical Tools on Team Responsibility Allocation:

   • The implementation of tools disrupted existing responsibility allocations and boundaries within the team, requiring members to take on greater ethical awareness, which introduced stress and ambiguity.
   • Ethical tools demanded the identification of ethical ownership within the team, but the personal stress associated with this role was not adequately recognized.

2. Introducing the Concept of "Moral Stress" as a Key Factor in Ethical Tool Failures:

   • Moral stress manifested as unease and conflict among team members when engaging in ethical reflection, such as balancing limited resources with ideal project outcomes.
   • Moral stress arose from the tension between striving for higher ethical standards and the constraints imposed by organizational and project resources.

3. Highlighting the Importance of Internal Team Relationships and Support:

   • A positive team culture (openness, collaboration, feedback mechanisms) was critical in alleviating moral stress but was insufficient to address broader organizational limitations.

4. Analyzing How Organizational Structures Constrain Ethical Performance:

   • While ethical tools created spaces for reflection, they could not alter organizational decision-making norms or technology-driven cultures.
   • Technical teams often faced ambiguous responsibilities for ethical decisions and external pressures, such as balancing public expectations with governmental objectives.

What are the advantages compared to existing solutions?

• It emphasizes that the impact of ethical tools extends beyond technical processes to include team emotions and organizational culture.
• It directly identifies that the failure of ethical tools is not due to the tools themselves but rather the unaddressed moral stress and organizational constraints faced by technical teams.
• It provides insights into alleviating moral stress through team support and organizational structural changes.

What were the experimental or evaluation results?

• Based on field study data, the authors confirmed that moral stress is prevalent among technical teams, particularly when dealing with ethical complexities or challenging existing technology-driven norms.
• Moral stress manifested in various ways within internal and external team relationships, affecting work efficiency and potentially undermining long-term engagement with ethical tools.

Limitations and Future Directions

Limitations:

• The study focused on a single team, and the generalizability of the findings requires further validation.
• It did not explicitly address how emotional support mechanisms could be broadly implemented across different organizations.

Future Directions:

• Investigating how to establish support structures within organizations to alleviate moral stress, such as regular team feedback or ethical response strategies.
• Exploring the long-term impact of moral stress on cross-departmental collaboration and policy-making.
• Further studying the pathways from ethical tools to organizational cultural transformation.

This paper advances the study of technology ethics by highlighting moral stress as a critical factor in the implementation of ethical tools, emphasizing the importance of emotions and team culture in ethical translation. Its innovative perspective offers valuable insights for ethical tool developers and technical organizations to learn from and apply in practice.