Tino Weinkauf

DxHF: Providing High-Quality Human Feedback for LLM Alignment with Interactive Decomposition

Human preferences are widely used to align large language models (LLMs) through methods such as reinforcement learning from human feedback (RLHF). However, the current user interfaces require annotators to compare text paragraphs, which is cognitively challenging when the texts are long or unfamiliar. This paper contr…