Mark Cartwright

schoolNew York Universitybar_chart#4956 Global Rank

Total Papers

HCI Rank

#4956

Research Areas

Years Active

Recent Publications

Eliciting Confidence for Improving Crowdsourced Audio Annotations

In this work we explore confidence elicitation methods for crowdsourcing “soft” labels, e.g., probability estimates, to reduce the annotation costs for domains with ambiguous data. Machine learning research has shown that such “soft” labels are more informative and can reduce the data requirements when training superv…

CHI '191st AuthorData Storytelling +2

Crowdsourcing Multi-label Audio Annotation Tasks with Citizen Scientists

Annotating rich audio data is an essential aspect of training and evaluating machine listening systems. We approach this task in the context of temporally-complex urban soundscapes, which require multiple labels to identify overlapping sound sources. Typically this work is crowdsourced, and previous studies have shown…

CSCW '181st AuthorCrowdsourcing

Seeing Sound: Investigating the Effects of Visualizations and Complexity on Crowdsourced Audio Annotations

Audio annotation is key to developing machine-listening systems; yet, effective ways to accurately and rapidly obtain crowdsourced audio annotations is understudied. In this work, we seek to quantify the reliability/redundancy trade-off in crowdsourced soundscape annotation, investigate how visualizations affect accur…

Quick Actions

Share this page

ios_share

X in mail

https://hci.top/en/authors/3903?source=all