Sticky Goals: Understanding Goal Commitments for Behavioral Changes in the Wild

Title of the Paper

Sticky Goals: Understanding Goal Commitments for Behavioral Changes in the Wild

Paper Information

• Research Area: Behavioral Interventions and Goal Management, Human-Computer Interaction (HCI)
• Keywords: Behavior Change Support Systems, Goal Setting, Commitment Devices, Financial and Social Commitments, Data-Driven Analysis

Research Background and Problem

• Issues and Challenges:

  • Commitment devices have been proven to facilitate goal achievement, but their usage and effectiveness in real-world settings have not been systematically studied.
  • Existing research is often based on laboratory environments, typically focusing on single behavioral goals without exploring large-scale, diverse behavioral data.
  • The design space combining social and financial commitments is still in its early stages in research, and its effectiveness in real-world applications remains unclear.

• Significance:

  • Improving the success rate of behavioral goals has broad applications in areas such as health management, productivity enhancement, and mental health.
  • Understanding the requirements and parameter design of commitment devices can provide optimization directions for behavior change support systems.

• Research Motivation and Related Work:

  • Commitment devices help individuals overcome short-term behavioral preferences (e.g., hedonism) by restricting future behavior or imposing penalties for failure, thereby achieving long-term goals.
  • While social support and financial incentive strategies have been studied to some extent, their combined effects and practical design applications remain open questions.

Solution

• Proposed Approach:

  • Analyze large-scale goal data (a total of 75,828 goals) extracted from the stickK platform, an online behavior change support system, including data on financial and social commitment devices, as well as user goal-setting and success rates.

• Innovations:

  • Conduct the first systematic study on the impact of mixed designs of various commitment devices (financial and social) on goal achievement.
  • Employ a data-driven approach, combining qualitative and quantitative analyses, to explore the effectiveness of commitment devices in real-world settings.

• Specific Steps:

  • Data Collection: Use web scraping techniques to extract goal data from the stickK platform from 2013 to 2018.
  • Goal Classification: Perform thematic analysis on a random sample of goal descriptions to classify goal types.
  • Variable Analysis: Apply multilevel regression analysis to evaluate the impact of various commitment device configurations on goal success rates.
  • Comparative Analysis: Compare the effects of different goal types (e.g., weight loss, quitting smoking) and commitment configurations.

Research Findings

• Specific Results:

  • Goal themes were primarily concentrated in health and fitness (70%), followed by productivity, self-development, finance, and social life.
  • Success rates were significantly positively correlated with financial commitment devices, particularly with high-stakes deposits and anti-charity recipients.
  • Short-term goals (e.g., goals to be completed within a week) were easier to achieve than long-term goals.
  • Social activities (e.g., uploading photos and posts about goal progress) were positively associated with goal success rates.

• Advantages:

  • The results highlighted the strong influence of financial commitment devices (e.g., penalties and anti-charity strategies) while revealing the auxiliary role of social support and social responsibility in behavior change.
  • Provided data-driven recommendations for personalized goal setting and optimization of commitment devices.

• Experimental or Evaluation Results:

  • Multilevel regression analysis indicated that key variables of financial commitment devices (e.g., total deposit amount and recipient type) significantly improved success rates (P < .001).
  • Social commitment devices (e.g., referee friends) still significantly promoted goal success in the absence of financial commitment devices.
  • Psychological drivers (e.g., avoiding penalties from anti-charity organizations) were particularly effective in influencing behavior change.

• Limitations and Future Directions:

  • Limitations: A large number of contracts were omitted during data cleaning, and demographic information (e.g., gender, age) may be missing.
  • Future Work:
    • Explore specific design optimizations of commitment devices across different behavioral categories.
    • Conduct studies on a broader user base (including multi-platform data) to validate the generalizability of the findings.
    • Develop automated systems to generate personalized social support networks and commitment device configuration recommendations.

Conclusion

This paper systematically reveals the effects and potential design directions of commitment devices (especially financial and social commitments) through the analysis of large-scale user goal data, providing important theoretical and practical guidance for optimizing behavior change support systems. By integrating theoretical background and empirical data analysis, the study offers new insights for future research and calls for the exploration of diverse designs and cross-domain applications of commitment devices.