Reflection in Theory and Reflection in Practice: An Exploration of the Gaps in Reflection Support among Personal Informatics Apps

Document Title

Reflection in Theory and Reflection in Practice: An Exploration of the Gaps in Reflection Support among Personal Informatics Apps

Document Information

• Subject Area: Research on personal informatics applications and reflection support in the field of human-computer interaction
• Keywords: Personal informatics, reflection, self-tracking, user autonomy, mobile applications

Research Background and Issues

• Issues/Challenges:
  The authors point out that although personal informatics systems aim to support users' reflective behaviors to promote self-awareness and positive behavior change, there is still insufficient research on how and when reflection occurs. Moreover, the support for reflection in commercial personal informatics applications is uneven, particularly in their inability to effectively stimulate user-driven reflection, assist users in goal setting, configure data collection and presentation methods, and consider the social and ethical implications of the applications.

• Importance:
  Supporting users in effective reflection is central to the success of personal informatics tools in promoting behavioral change and cognitive development. Tools that lack explicit reflection support may limit users' ability to derive meaning and gain deep insights from their lived experiences.

• Research Motivation and Related Work:
  The motivation for this research is to explore the design deficiencies in the reflection support provided by current commercial personal informatics applications and propose improvement strategies. The authors reference a substantial body of literature on reflection theories and personal informatics models, such as the stage-based model by Li et al. and the reflection levels framework by Fleck and Fitzpatrick.

Solution

• Methods/Solutions:
  The authors conducted a large-scale analysis of commercial personal informatics applications and developed a coding framework based on the five levels of reflection proposed by Fleck and Fitzpatrick (descriptive reflection, interpretive reflection, dialogic reflection, transformative reflection, and critical reflection) to evaluate the design elements that support reflection within these applications.

• Innovations:
  A reflection coding framework combining theory and practice was proposed, revealing deficiencies in personal informatics applications in supporting reflection, particularly user-driven reflection. The study systematically analyzed the design mechanisms that support different levels of reflection from the perspective of application functionality.

• Implementation Steps and Techniques:

  1. Building an application library: Collected 123 commercial personal informatics applications covering self-tracking goals in areas such as health, fitness, and finance.
  2. Iterative coding analysis: Conducted a detailed analysis of each application's interactive features, data collection and presentation methods, and whether they support reflection, based on the reflection theory framework.
  3. Proposing a design space: Summarized the current state of reflection support in commercial application functionalities and compared them with the theoretically supported levels of reflection.

Research Outcomes

• Specific Findings:

  1. Commercial personal informatics applications exhibit significant imbalances in supporting reflection: lower-level reflections (descriptive and interpretive reflection) are well-supported, while higher-level reflections (transformative and critical reflection) are lacking.
  2. Current designs tend to be system-driven, emphasizing automated data processing and presentation while neglecting the importance of user autonomy in the reflective process.
  3. Social features are rarely used to support reflection effectively, serving only for data comparison or motivation, without reaching the level of transformative reflection.

• Strengths:
  The study systematically reveals the design blind spots of commercial personal informatics applications and provides an in-depth analysis of how to support users in deep reflection through design, thereby improving the practical effectiveness of data tracking tools.

• Experimental or Evaluation Results:
  The research focuses on analyzing application functionalities and does not include long-term user studies or behavioral outcomes. However, the conclusions are based on extensive existing literature and comparative analysis of application cases.

• Limitations and Future Directions:

  1. This study is based on Western reflection theories, which may not fully encompass reflective practices in other cultural contexts.
  2. As the research primarily focuses on application design, it does not deeply explore the actual reflective processes users experience in their daily lives when using these applications.
  3. Future research is suggested to focus on optimizing personal informatics tools to integrate users' actual usage habits, long-term tracking patterns, and cross-cultural perspectives on reflection support.

Conclusion

By combining theoretical and practical research, the authors comprehensively evaluate the support for user reflection in personal informatics applications and propose new directions for improving the design of next-generation personal informatics tools. These include personalized data collection, user-autonomous data presentation, and refined design for different levels of reflection. These recommendations hold significant implications for designing digital tools that support self-tracking and reflection.