Deceptive Design Patterns in Safety Technologies: A Case Study of the Citizen App

Document Title

Application of Deceptive Design Patterns in Security Technology: A Case Study of the Citizen App

Document Information

• Subject Area: Human-Computer Interaction (HCI), Security Technology, Design Ethics
• Keywords: Deceptive Design Patterns, Security Technology, Crime, Community Safety, Fear, Anxiety, Social Inequity, Data Privacy, Community Surveillance

Research Background and Problem

• What problems or challenges did the authors identify?

  • Deceptive design patterns (formerly known as dark patterns) are prevalent across various technologies, yet their presence in the domain of security technology has not been thoroughly documented. While existing literature highlights the profound impacts of security technology on users and communities—such as racial bias and online racism—the underlying design decisions and profit-driven motivations remain underexplored.
  • The primary research question is: Do security technologies utilize deceptive design patterns to heighten users' anxiety about security incidents, thereby driving the use of profit-generating features?

• Why is this issue important?

  • Design decisions in security technologies can influence users' online and offline behaviors, potentially exacerbating biases against marginalized racial or socioeconomic groups. Such designs may undermine community cohesion and fairness, amplifying societal inequities.

• Research Motivation and Related Work

  • By synthesizing research on deceptive design patterns in HCI and examining the emotional and behavioral impacts of security technologies, the authors aim to investigate how deceptive design patterns interact with cognitive biases and sociocultural factors to produce widespread negative effects.
  • Related research includes studies on deceptive design patterns in e-commerce platforms, social media, and data privacy, as well as the influence of security technologies on community interactions, fear of crime, and racial bias.

Solution

• What methods or solutions did the authors propose?

  • The authors employed a case study approach, focusing on the Citizen app, combining user interviews and interface analysis to explore the impact of deceptive design patterns in security technology on user experience. Specific analyses included:
    • Semi-structured interviews with 15 users in Atlanta to understand their real-world experiences with the app.
    • Systematic analysis of the Citizen app interface to identify deceptive design patterns.

• What is innovative about this solution?

  • The study broadens the focus from individual features to the sociotechnical infrastructure of the technology, introducing the concept of "deceptive infrastructure" to describe the interplay between deceptive design patterns, cognitive biases, and cultural factors, as well as their holistic impact on users and society.
  • The authors propose expanding existing harm classification frameworks to comprehensively account for the effects of deceptive design patterns, including emotional burden and social inequity.

• What are the implementation steps? What key techniques were used?

  • Data collection: Conducted interviews with 15 users and analyzed the app interface, recording user interaction videos to capture the manifestation of design patterns.
  • Data analysis: Used qualitative coding, iterative group discussions, and affinity diagramming to extract key themes and patterns.
  • Data integration: Merged findings from user experiences and interface analysis to form unified conclusions based on functional and conceptual alignment.

Research Findings

• What specific results were achieved?

  • Identified six deceptive design patterns in the Citizen app, including "forced action," "social investment," and "privacy exposure." These designs manipulated user choice architecture to induce security-related anxiety and incentivize the use of profit-driven features.
  • Users reported negative emotional experiences (e.g., anxiety, fear) associated with the app, with these emotional burdens increasing over time.

• How does it compare to existing solutions?

  • Unlike prior research on deceptive design patterns, this study emphasizes the sociocultural impacts and systemic interactions of these patterns, rather than focusing solely on specific design techniques and their direct effects on individual user behavior.
  • The study offers concrete recommendations for design practices, such as filtering information, prioritizing diverse content, and supporting community collaboration to reduce unnecessary anxiety and promote social cooperation.

• What were the experimental or evaluation results?

  • User interviews revealed that while the Citizen app heightened awareness of crime incidents, excessive information and unnecessary alerts generated unwarranted fear and stress.
  • Most users reported changes in their offline behaviors (e.g., avoiding certain areas) and shifts in perceptions of specific communities or groups. These behavioral changes could lead to long-term community segregation and racial or economic bias.

• Limitations and Future Directions

  • Limitations include: a sample skewed toward white female users, behavioral tracking constrained by the sample city and timeframe, and an inability to directly capture the impact of certain features (e.g., Citizen Protect).
  • The authors suggest future research should adopt longitudinal designs to observe the evolution of design patterns over time and further investigate the composition of emotional burdens and the technology's impact on diverse cities and communities.

Contributions and Recommendations

• Expanded Mathur et al.'s harm classification framework by incorporating "emotional burden" and "social inequity" as key harm categories.
• Proposed four design recommendations:
  • (1) Empower users with the ability to selectively engage with safety information.
  • (2) Present danger in a longitudinal and diverse contextual manner across temporal and spatial dimensions.
  • (3) Actively counteract cultural stereotypes by integrating balanced narratives and media literacy education into design.
  • (4) Provide constructive outlets for fear, such as supporting community collaboration and nonprofit intervention activities.

Through these recommendations, designers can critically reflect on and mitigate the negative impacts of existing security technologies, paving the way for the creation of equitable technological ecosystems that replace deceptive infrastructures.