Ana Elisa Mendez Mendez

Eliciting Confidence for Improving Crowdsourced Audio Annotations

In this work we explore confidence elicitation methods for crowdsourcing “soft” labels, e.g., probability estimates, to reduce the annotation costs for domains with ambiguous data. Machine learning research has shown that such “soft” labels are more informative and can reduce the data requirements when training superv…