James M. Johnson

schoolIBMbar_chart#5524 Global Rank

Total Papers

HCI Rank

#5524

Research Areas

Years Active

Recent Publications

EvalAssist: Insights on Task-Specific Evaluations and AI-Assisted Judgment Strategy Preferences

With the broad availability of large language models and their ability to generate vast outputs using varied prompts and configurations, determining the best output for a given task requires an intensive evaluation process, one where machine learning practitioners must decide how to assess the outputs and then careful…

CSCW '233rd AuthorHuman AI Collaboration II

Decision Making Strategies and Team Efficacy in Human-AI Teams

Human-AI teams are increasingly prevalent in various domains. We investigate how the decision-making of a team member in a human-AI team impacts the outcome of the collaboration and perceived team-efficacy. In a large scale study on Mechanical Turk (n=125), we find significant differences across different decision ma…

DIS '233rd AuthorHuman-LLM Collaboration +2

SME-in-the-loop: Interaction Preferences when Supervising Bots in Human-AI Communities

Subject matter experts play an important role in customer support communities by responding to user queries. Some communities have adopted chatbots in addition to SMEs to address commonly asked questions. Yet, SME-bot interactions, particularly teaching paradigms between SMEs and bots remain understudied. We investiga…

Quick Actions

Share this page

ios_share

X in mail

https://hci.top/en/authors/31807?source=all