lightbulbPractical problemAlgorithm Contestability and Governance Auditing
Third-party algorithm auditing cannot conduct reliable fairness evaluation due to limited data access.Fairness, Bias, and Research Governance / Algorithm Contestability and Governance Auditing
Third-party algorithm auditing cannot conduct reliable fairness evaluation due to limited data access.
Similar questions
lightbulbPractical problemAlgorithm Contestability and Governance Auditing
AI auditing lacks adequate tools and standardization for identifying risks and system limitations.lightbulbPractical problemAlgorithm Contestability and Governance Auditing
University students tend to accept LLM content uncritically and lack critical thinking.lightbulbPractical problemAlgorithm Contestability and Governance Auditing
Negative impacts of AI design and decisions are hard to attribute, and public participation is limited.CSCW '24From Stem to Stern: Contestability Along AI Value Chains
lightbulbPractical problemAlgorithm Contestability and Governance Auditing
Marginalized groups struggle to obtain fair outcomes in algorithmic public services.lightbulbPractical problemAlgorithm Contestability and Governance Auditing
Non-technical users struggle to efficiently design and test LLM prompts, leading to slow optimization.lightbulbPractical problemAlgorithm Contestability and Governance Auditing
Users struggle to effectively participate in AI testing and auditing to discover problems and bias.CSCW '23Supporting User Engagement in Testing, Auditing, and Contesting AI
Related papers
CHI 2025
Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling
Victor Ojewale, Ryan Steed, Briana Vecchione
CHI 2025
"Here the GPT made a choice, and every choice can be biased": How Students Critically Engage with LLMs through End-User Auditing Activity
Snehal Prabhudesai, Ananya Prashant Kasi, Anmol Mansingh
CHI 2025
Access Denied: Meaningful Data Access for Quantitative Algorithm Audits
Juliette Zaccour, Reuben Binns, Luc Rocher
CHI 2024
Understanding Contestability on the Margins: Implications for the Design of Algorithmic Decision-making in Public Services
Naveena Karusala, Sohini Upadhyay, Rajesh Veeraraghavan
CHI 2024
ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis Testing
Ian Arawjo, Chelse Swoopes, Priyan Vaithilingam
CHI 2023
Participation and Division of Labor in User-Driven Algorithm Audits: How Do Everyday Users Work Together to Surface Algorithmic Harms?
Rena Li, Sara Kingsley, Chelsea Fan
CHI 2023
Disentangling Fairness Perceptions in Algorithmic Decision-Making: the Effects of Explanations, Human Oversight, and Contestability.
Mireia Yurrita, Tim Draws, Agathe Balayn
CHI 2022
Toward User-Driven Algorithm Auditing: Investigating Users' Strategies for Uncovering Harmful Algorithmic Behavior
Alicia DeVos, Aditi Dhabalia, Hong Shen