helpResearch questionCrowdsourcing Task Clarity and Quality Control
How does GPT-4 compare with crowd workers in data annotation performance?Direction: Data Annotation, Model Debugging, and Data Work
Crowdsourcing Task Clarity and Quality Control
Stats are based on currently indexed question data; missing sources remain visible.
8
items
2
sources
2024
latest
All questions
8 items
helpResearch questionCrowdsourcing Task Clarity and Quality Control
How can combining GPT-4 and crowd worker labels improve data annotation accuracy?helpResearch questionCrowdsourcing Task Clarity and Quality Control
How does interface design affect crowd workers' data annotation quality?lightbulbPractical problemCrowdsourcing Task Clarity and Quality Control
Large-scale high-quality data annotation is costly and inefficient.helpResearch questionCrowdsourcing Task Clarity and Quality Control
How can computational methods identify ambiguities in crowdsourcing task descriptions to improve clarity?IUI '23Supporting Requesters in Writing Clear Crowdsourcing Task Descriptions Through Computational Flaw Assessment
helpResearch questionCrowdsourcing Task Clarity and Quality Control
Which ambiguity dimensions most significantly affect workers' understanding and task outcome quality?IUI '23Supporting Requesters in Writing Clear Crowdsourcing Task Descriptions Through Computational Flaw Assessment
helpResearch questionCrowdsourcing Task Clarity and Quality Control
Can automated tools effectively help novice requesters improve crowdsourcing task description clarity?IUI '23Supporting Requesters in Writing Clear Crowdsourcing Task Descriptions Through Computational Flaw Assessment
lightbulbPractical problemCrowdsourcing Task Clarity and Quality Control
Novice requesters struggle to write clear crowdsourcing task descriptions, leading to low task execution quality.IUI '23Supporting Requesters in Writing Clear Crowdsourcing Task Descriptions Through Computational Flaw Assessment
Related papers
Adjacent categories
Data Annotation, Model Debugging, and Data Work
Human-in-the-Loop Labeling and Example Selection
149 items
Data Annotation, Model Debugging, and Data Work
Contextual Example Selection and Rare Pattern Coverage
44 items
Data Annotation, Model Debugging, and Data Work
Label Schema Design and Crowdsourced Feedback Optimization
12 items
Data Annotation, Model Debugging, and Data Work
NLP Model Error Analysis and Visualization Support
8 items
Data Annotation, Model Debugging, and Data Work
Object Detection Annotation Assistance
4 items
Data Annotation, Model Debugging, and Data Work
Data Slicing and Model Debugging
4 items