Exploring Personalized Health Support through Data-Driven, Theory-Guided LLMs: A Case Study in Sleep Health
Authors
Research Background and Issues
-
Issues and Challenges:
The authors point out that although sleep monitoring devices are widely available, users still struggle to translate data into actionable recommendations for improving sleep health. Current interventions can provide data-driven suggestions but often lack adaptability to real-life constraints and individual-specific contexts. Many existing template-based recommendations fail to flexibly address users' dynamic needs, resulting in limited engagement and effectiveness in behavior change. -
Importance of the Issue:
Sleep is a critical factor for human health, influencing physical, cognitive, and emotional resilience. However, sustained health interventions aimed at optimizing sleep remain challenging due to difficulties in transforming complex sleep data into personalized and motivational behavioral guidance. -
Research Motivation and Related Work:
The authors conducted a systematic analysis of existing research and technologies, including systems that provide sleep data insights using sleep monitoring devices (e.g., Fitbit and Oura Ring) and studies leveraging health behavior conversational technologies to promote user health interventions. However, these approaches suffer from poor flexibility, insufficient personalization, and a lack of timely recommendations, particularly in the domain of sleep health, where dynamic adaptive interventions guided by theoretical frameworks are lacking.
Solution
-
Proposed Solution:
The authors developed an intelligent health-support chatbot named HEALTH GURU. This system integrates large language models (LLM), wearable device data, contextual information, and behavior change theories to deliver personalized and context-adaptive sleep interventions. Additionally, it enhances user motivation through conversational interactions. -
Innovations:
- Utilizes a multi-agent system framework to combine LLM's natural language processing capabilities with specific sleep health intervention goals.
- Introduces a Contextual Multi-Armed Bandit (MAB) model to dynamically adjust health recommendations, leveraging validated effective activities while exploring potential new ones.
- Enhances the scientific validity and user adaptability of recommendations through guidance from behavior change theories (e.g., self-efficacy and habit formation theories).
-
Implementation Steps:
- Data Integration: Aggregates physiological data, sleep patterns, and activity records from wearable devices (e.g., Oura Ring).
- Context-Based Recommendation Model: The MAB model dynamically generates personalized activity suggestions, such as recommending suitable sleep-enhancing activities (e.g., running or meditation) based on weather and time.
- Application of Behavior Change Theories: Uses LLM technology to transform action recommendations into theory-guided conversational content, such as helping users set goals, providing feedback, and offering emotional support.
- Multi-Agent Architecture: Agents within the system handle data analysis, recommendation generation, and user interaction, ensuring comprehensive data synthesis and coherent responses.
Research Outcomes
-
Specific Results:
- HEALTH GURU significantly improved users' sleep duration (average daily increase of 22 minutes) and activity scores (from 71.37 to 75.41).
- The system demonstrated superior performance in personalization, contextual awareness, and recommendation relevance compared to baseline systems.
- Users engaged in longer conversations with HEALTH GURU and exhibited higher interaction persistence.
-
Advantages Over Existing Methods:
- Health interventions are highly tailored to users' individual conditions and environments, rather than relying on static template-based traditional methods.
- Provides a more natural conversational experience and real-time personalized feedback, significantly enhancing user motivation and engagement.
-
Experimental or Evaluation Results:
- Compared to baseline systems, HEALTH GURU achieved a significant improvement in user recommendation adherence (from 36.71% to 47.94%).
- Higher system engagement, with the proportion of active user days increasing from 0.31 to 0.39.
- Users reported better understanding of the relationship between sleep and activities and perceived the health recommendations as more contextually relevant.
-
Limitations and Future Directions:
- Data Accuracy: The monitoring accuracy of Oura Ring is subject to certain limitations, leading to potential discrepancies between data and users' actual experiences.
- Contextual Constraints: Currently, only basic contextual factors such as weather and time are considered; future work could integrate more variables (e.g., work schedules, health conditions).
- Long-Term Intervention Effects: Due to the short experimental duration (eight weeks), the sustained impact of long-term use on behavior change remains unverified.
- Sample Diversity: The experiment participants were predominantly young adults; future studies should test applicability across broader demographics.
- Technical Improvements: Enhancing data visualization and multimodal interactions (e.g., voice control) could lower user barriers to adoption.
By introducing a dynamically adaptive health intervention mechanism and a theory-guided AI framework, HEALTH GURU provides new design insights and practical references for future LLM-based health applications.
Research Questions / Practical Problems
Question signals indexed for this paper.
Research Questions
3- Can personalized training effectively improve users' phishing detection ability?Category: Responsible Data Practices and Behavior InterventionSimilar questionsarrow_forward
- Is modular training based on user ability levels (high, medium, low) superior to random assignment or generic training?Category: Responsible Data Practices and Behavior InterventionSimilar questionsarrow_forward
- How can phishing training be personalized without relying on sensitive data?Category: Responsible Data Practices and Behavior InterventionSimilar questionsarrow_forward
Practical Problems
1- Traditional one-size-fits-all phishing training ignores individual differences and has limited effectiveness.Category: Responsible Data Practices and Behavior InterventionSimilar questionsarrow_forward
- 80%
Balancing Flexibility and Authority: Exploring Negotiation as an Interaction Strategy for Healthy Sleep Behaviors
DIS '23· Mental Health Apps & Online Support Communities +1
- 67%
SleepBandits: Guided Flexible Self-Experiments for Sleep
CHI '20· Mental Health Apps & Online Support Communities +1
- 67%
ZenVR: Design Evaluation of a Virtual Reality Learning System for Meditation
CHI '22· VR Medical Training & Rehabilitation +2
- 67%
DeepStress: Supporting Stressful Context Sensemaking in Personal Informatics Systems Using a Quasi-experimental Approach
CHI '24· Mental Health Apps & Online Support Communities +1
- 60%
A Review on Strategies for Data Collection, Reflection, and Communication in Eating Disorder Apps
CHI '21· Mental Health Apps & Online Support Communities +1
- 60%
Facilitating Self-Guided Mental Health Interventions Through Human-Language Model Interaction: A Case Study of Cognitive Restructuring
CHI '24· Human-LLM Collaboration +1
- 60%
"I Don’t Know Why I Should Use This App”: Holistic Analysis on User Engagement Challenges in Mobile Mental Health
CHI '25· Human-LLM Collaboration +1
- 60%
Exploring Modular Prompt Design for Emotion and Mental Health Recognition
CHI '25· Human-LLM Collaboration +2
- 60%
Design Opportunities for Digital Men's Health: An Exploratory Study Focusing on Football Fandom
DIS '20· Mental Health Apps & Online Support Communities +1
- 60%
Counselor-AI Collaborative Transcription and Editing System for Child Counseling Analysis
IUI '25· Human-LLM Collaboration +1
Based on Jaccard similarity of research subtopics & professions (≥60%)