Leveraging ChatGPT for Automated Human-centered Explanations in Recommender Systems
Authors
The adoption of recommender systems (RSs) in various domains has become increasingly popular, but concerns have been raised about their lack of transparency and interpretability. While significant advancements have been made in creating explainable RSs, there is still a shortage of automated approaches that can deliver meaningful and contextual human-centered explanations. Numerous researchers have evaluated explanations based on human-generated recommendations and explanations to address this gap. However, such approaches do not scale for real-world systems. Building on recent research that exploits Large Language Models (LLMs) for RSs, we propose leveraging the conversational capabilities of ChatGPT to provide users with personalized, human-like, and meaningful explanations for recommended items. Our paper presents one of the first user studies that measure users' perceptions of ChatGPT-generated explanations while acting as an RS. Regarding recommendations, we assess whether users prefer ChatGPT over random (but popular) recommendations. Concerning explanations, we assess users' perceptions of personalization, effectiveness, and persuasiveness. Our findings reveal that users tend to prefer ChatGPT-generated recommendations over popular ones. Additionally, personalized rather than generic explanations prove to be more effective when the recommended item is unfamiliar.
Research Questions / Practical Problems
Question signals indexed for this paper.
Research Questions
3- Can ChatGPT-generated recommendation explanations outperform random explanations in personalization and persuasiveness?Category: Explanation, Control, and Trust in Recommendation SystemsSimilar questionsarrow_forward
- How do personalized explanations based on user preferences differ from generic explanations in perceived user effectiveness in recommendation systems?Category: Explanation, Control, and Trust in Recommendation SystemsSimilar questionsarrow_forward
- For unknown recommended items, which explanation types better improve user acceptance and trust?Category: Explanation, Control, and Trust in Recommendation SystemsSimilar questionsarrow_forward
Practical Problems
1- Users lack trust in recommendation system content and do not understand recommendation rationales.Category: Explanation, Control, and Trust in Recommendation SystemsSimilar questionsarrow_forward
- 100%
Surprise Me If You Can: Serendipity in Health Information
CHI '18· Human-LLM Collaboration +2
- 67%
End User Authoring of Personalized Content Classifiers: Comparing Example Labeling, Rule Writing, and LLM Prompting
CHI '25· Human-LLM Collaboration +1
- 60%
ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis Testing
CHI '24· Human-LLM Collaboration +2
Based on Jaccard similarity of research subtopics & professions (≥60%)