Zeyu He

schoolPennsylvania State Universitybar_chart#7001 Global Rank

Total Papers

HCI Rank

#7001

Research Areas

Years Active

Recent Publications

Prompting in the Dark: Assessing Human Performance in Prompt Engineering for Data Labeling When Gold Labels Are Absent

Millions of users prompt large language models (LLMs) for various tasks, but how good are people at prompt engineering? Do users actually get closer to their desired outcome over multiple iterations of their prompts? These questions are crucial when no gold-standard labels are available to measure progress. This paper…

CHI '241st AuthorGenerative AI (Text, Image, Music, Video) +1

If in a Crowdsourced Data Annotation Pipeline, a GPT-4

Recent studies indicated GPT-4 outperforms online crowd workers in data labeling accuracy, notably workers from Amazon Mechanical Turk (MTurk). However, these studies were criticized for deviating from standard crowdsourcing practices and emphasizing individual workers' performances over the whole data-annotation proc…

Quick Actions

Share this page

ios_share

X in mail

https://hci.top/en/authors/13303?source=all