helpResearch questionAlgorithm Contestability and Governance Auditing
Which existing tools in AI auditing can truly achieve accountability?Direction: Fairness, Bias, and Research Governance
Algorithm Contestability and Governance Auditing
Stats are based on currently indexed question data; missing sources remain visible.
40
items
10
sources
2025
latest
All questions
40 items
helpResearch questionAlgorithm Contestability and Governance Auditing
At which stages do existing AI auditing tools have functional or coverage gaps?helpResearch questionAlgorithm Contestability and Governance Auditing
How can AI auditing tools be improved to support more complete social accountability processes?lightbulbPractical problemAlgorithm Contestability and Governance Auditing
AI auditing lacks adequate tools and standardization for identifying risks and system limitations.helpResearch questionAlgorithm Contestability and Governance Auditing
How can university students audit large language model (LLM) bias and improve critical AI literacy without technical education?helpResearch questionAlgorithm Contestability and Governance Auditing
Can staged support from user auditing tools (e.g., PromptAuditor) effectively improve students' systematic bias auditing ability?helpResearch questionAlgorithm Contestability and Governance Auditing
How does auditing scaffolding change students' understanding and analysis of LLM bias?lightbulbPractical problemAlgorithm Contestability and Governance Auditing
University students tend to accept LLM content uncritically and lack critical thinking.helpResearch questionAlgorithm Contestability and Governance Auditing
How do different data-access scenarios affect accuracy of algorithmic fairness evaluation?helpResearch questionAlgorithm Contestability and Governance Auditing
How can privacy-preserving techniques such as differential privacy and data minimization balance privacy protection and analytic reliability in algorithm auditing?helpResearch questionAlgorithm Contestability and Governance Auditing
What are specific impacts of low-quality and incomplete data on fairness-evaluation results?lightbulbPractical problemAlgorithm Contestability and Governance Auditing
Third-party algorithm auditing cannot conduct reliable fairness evaluation due to limited data access.helpResearch questionAlgorithm Contestability and Governance Auditing
Which stages of the AI value chain are prone to negative impacts, and how can contestability in these stages be improved?CSCW '24From Stem to Stern: Contestability Along AI Value Chains
helpResearch questionAlgorithm Contestability and Governance Auditing
How can multidisciplinary perspectives improve feedback and accountability mechanisms in the AI ecosystem?CSCW '24From Stem to Stern: Contestability Along AI Value Chains
helpResearch questionAlgorithm Contestability and Governance Auditing
Can real-world case studies inform contestability solutions compatible with regional and cultural differences?CSCW '24From Stem to Stern: Contestability Along AI Value Chains
lightbulbPractical problemAlgorithm Contestability and Governance Auditing
Negative impacts of AI design and decisions are hard to attribute, and public participation is limited.CSCW '24From Stem to Stern: Contestability Along AI Value Chains
helpResearch questionAlgorithm Contestability and Governance Auditing
How can effective algorithmic decision contestability mechanisms be implemented in non-Western countries and among marginalized groups?helpResearch questionAlgorithm Contestability and Governance Auditing
How can the concept of 'accompaniment' be adapted to algorithmic decision design in public services?helpResearch questionAlgorithm Contestability and Governance Auditing
How can marginalized groups better protect their rights and contest outcomes in complex algorithmic decision procedures?lightbulbPractical problemAlgorithm Contestability and Governance Auditing
Marginalized groups struggle to obtain fair outcomes in algorithmic public services.helpResearch questionAlgorithm Contestability and Governance Auditing
How can a tool be designed for non-technical users to simplify and intuitivize LLM prompt design and hypothesis testing?helpResearch questionAlgorithm Contestability and Governance Auditing
In workflows comparing responses across multiple models and prompt variables, how can systematic and exploratory analysis be efficiently supported?helpResearch questionAlgorithm Contestability and Governance Auditing
Which feature designs are best suited for non-technical users in LLM behavior auditing (e.g., bias and safety issues)?lightbulbPractical problemAlgorithm Contestability and Governance Auditing
Non-technical users struggle to efficiently design and test LLM prompts, leading to slow optimization.helpResearch questionAlgorithm Contestability and Governance Auditing
How can tools and processes be designed to support user participation in AI testing, auditing, and questioning?CSCW '23Supporting User Engagement in Testing, Auditing, and Contesting AI
helpResearch questionAlgorithm Contestability and Governance Auditing
How can users and AI developers overcome power imbalances and build trust during auditing?CSCW '23Supporting User Engagement in Testing, Auditing, and Contesting AI
helpResearch questionAlgorithm Contestability and Governance Auditing
How can users from different backgrounds collaboratively discover and report bias and issues in AI systems?CSCW '23Supporting User Engagement in Testing, Auditing, and Contesting AI
lightbulbPractical problemAlgorithm Contestability and Governance Auditing
Users struggle to effectively participate in AI testing and auditing to discover problems and bias.CSCW '23Supporting User Engagement in Testing, Auditing, and Contesting AI
helpResearch questionAlgorithm Contestability and Governance Auditing
How do users divide labor in algorithm auditing to reveal algorithmic bias?helpResearch questionAlgorithm Contestability and Governance Auditing
Which user behaviors help improve participation and effectiveness of user-driven algorithm auditing?helpResearch questionAlgorithm Contestability and Governance Auditing
How do short-term spikes in tweet interactions affect results of user-driven algorithm auditing?lightbulbPractical problemAlgorithm Contestability and Governance Auditing
Ordinary users struggle to effectively reveal algorithmic bias through interaction.helpResearch questionAlgorithm Contestability and Governance Auditing
How does explainability design for algorithmic decisions affect users' perceptions of informational fairness?helpResearch questionAlgorithm Contestability and Governance Auditing
How do contestability mechanisms affect users' views of procedural fairness in algorithmic decision processes?helpResearch questionAlgorithm Contestability and Governance Auditing
Does human oversight of algorithms improve or weaken users' perceptions of procedural fairness, and why?lightbulbPractical problemAlgorithm Contestability and Governance Auditing
Users distrust algorithmic decision outcomes due to lack of transparency and fairness.helpResearch questionAlgorithm Contestability and Governance Auditing
How do general users identify and evaluate potentially harmful algorithmic behavior?helpResearch questionAlgorithm Contestability and Governance Auditing
What key factors affect the effectiveness of users auditing algorithmic bias in everyday interactions?helpResearch questionAlgorithm Contestability and Governance Auditing
How can user-driven algorithm auditing processes support algorithmic fairness and transparency?lightbulbPractical problemAlgorithm Contestability and Governance Auditing
Algorithmic bias can cause social injustice, but general users struggle to detect these problems.Related papers
CHI 2025
Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling
Victor Ojewale, Ryan Steed, Briana Vecchione
CHI 2025
"Here the GPT made a choice, and every choice can be biased": How Students Critically Engage with LLMs through End-User Auditing Activity
Snehal Prabhudesai, Ananya Prashant Kasi, Anmol Mansingh
CHI 2025
Access Denied: Meaningful Data Access for Quantitative Algorithm Audits
Juliette Zaccour, Reuben Binns, Luc Rocher
CHI 2024
Understanding Contestability on the Margins: Implications for the Design of Algorithmic Decision-making in Public Services
Naveena Karusala, Sohini Upadhyay, Rajesh Veeraraghavan
CHI 2024
ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis Testing
Ian Arawjo, Chelse Swoopes, Priyan Vaithilingam
CHI 2023
Participation and Division of Labor in User-Driven Algorithm Audits: How Do Everyday Users Work Together to Surface Algorithmic Harms?
Rena Li, Sara Kingsley, Chelsea Fan
CHI 2023
Disentangling Fairness Perceptions in Algorithmic Decision-Making: the Effects of Explanations, Human Oversight, and Contestability.
Mireia Yurrita, Tim Draws, Agathe Balayn
CHI 2022
Toward User-Driven Algorithm Auditing: Investigating Users' Strategies for Uncovering Harmful Algorithmic Behavior
Alicia DeVos, Aditi Dhabalia, Hong Shen
Adjacent categories
Fairness, Bias, and Research Governance
Algorithmic Decision Accountability, Contestability, and User Auditing
121 items
Fairness, Bias, and Research Governance
Machine Learning Fairness and Data Development Practices
114 items
Fairness, Bias, and Research Governance
Race, Ethnicity Bias, and Black/Latinx/Indigenous/Minority Representation in Technology
98 items
Fairness, Bias, and Research Governance
Healthcare Equity, Clinical Algorithm Fairness, and Marginalized Patient Support
94 items
Fairness, Bias, and Research Governance
Bias and Fairness in Large Language Models and GenAI
86 items
Fairness, Bias, and Research Governance
Participatory Design and Community Equity Governance
76 items
Fairness, Bias, and Research Governance
Fairness, Bias, and Cultural Adaptation in Online Content Moderation
75 items
Fairness, Bias, and Research Governance
Educational Algorithm Fairness, Learning Opportunity, and Marginalized Student Support
74 items