Annalisa Szymanski

schoolUniversity of Notre Damebar_chart#1860 Global Rank

Total Papers

HCI Rank

#1860

Research Areas

Years Active

Recent Publications

Key Considerations for Domain Expert Involvement in LLM Design and Evaluation: An Ethnographic Study

Large Language Models (LLMs) are increasingly developed for use in complex professional domains, yet little is known about how teams design and evaluate these systems in practice. This paper examines the challenges and trade-offs in LLM development through a 12-week ethnographic study of a team building a pedagogical…

CHI '261st AuthorHuman-LLM Collaboration +3

Designing Staged Evaluation Workflows for LLMs: Integrating Domain Experts, Lay Users, and Model-Generated Evaluation Criteria

Large Language Models (LLMs) are increasingly utilized for domain-specific tasks, yet evaluating their outputs remains challenging. A common strategy is to apply evaluation criteria to assess alignment with domain-specific standards, yet little is understood about how criteria differ across sources or where each type…

CHI '261st AuthorDiet Tracking & Nutrition Management +2

Balancing Goals, Health, and Cost: A Food Information System for Managing Complex Choices and Fostering Sustained Food Agency

Technology offers new opportunities to support healthier food choices, particularly for individuals in low-income communities who face systemic barriers to obtaining nutritious, affordable groceries. We introduce a novel conceptual model of grocery planning that frames food purchasing as a multi-objective optimization…

IUI '251st AuthorHuman-LLM Collaboration +1

Limitations of the LLM-as-a-Judge Approach for Evaluating LLM Outputs in Expert Knowledge Tasks

The potential of using Large Language Models (LLMs) themselves to evaluate LLM outputs offers a promising method for assessing model performance across various contexts. Previous research indicates that LLM-as-a-judge exhibits a strong correlation with human judges in the context of general instruction following. Howe…

CHI '242nd AuthorGenerative AI (Text, Image, Music, Video) +2

Beyond Static Labels: Unpacking Nutrition Comprehension in the Digital Age

Understanding nutrition labels remains challenging for consumers; however, digital shopping environments offer opportunities to explore how interactive nutrition labels may be used to enhance comprehension. We conducted an A/B study with 24 participants, comparing their ability to interpret and apply nutrition informa…

CHI '241st AuthorGenerative AI (Text, Image, Music, Video) +2

Integrating Expertise in LLMs: Crafting a Customized Nutrition Assistant with Refined Template Instructions

Large Language Models (LLMs) have the potential to contribute to the fields of nutrition and dietetics in generating food product explanations that facilitate informed food selections. However, the extent to which these models offer effective and accurate information remains unverified. In collaboration with registere…

Quick Actions

Share this page

ios_share

X in mail

https://hci.top/en/authors/12532?source=all