Retrospective statistics have no power over use that already happened
Aliases: feedback intervention · just-in-time intervention
What it is
Usage reports are retrospective: they tell you last week took nine hours, but those nine hours already happened. The output of statistics is awareness — knowing — not intervention — stopping in the moment. Over use that has already occurred, a report exerts no direct force; deploying one as an intervention strategy mistakes the tool's category.
Why it happens
An intervention must enter the decision at the moment of behavior; the report arrives after the behavior ends, with an entire session in between. Everything it does is indirect: if the user cares about the data, the report can convert into a resolution before the next session — "today I'll hold back." But that resolution has no execution mechanism inside the session and offers no resistance to a gradually deepening state of immersion. Feedback's motivational effect also has a stable boundary: negative feedback (overrun), when unaccompanied by a strategy, tends to produce avoidance — not opening the report — rather than adjustment. None of this contradicts the cognitive value of statistics; it separates two distinct outputs. Knowing how long you used: the report delivers that. Being able to stop right now: statistics never supplied that.
Studying it
Feedback-intervention research: randomized experiments with behavioral logs as outcomes, varying feedback timing (immediate versus delayed), valence (positive versus negative), and accompanying strategies (goal setting, implementation intentions) as moderators. Methodological cautions: report open-rate is not feedback exposure — opening, reading, and understanding are three different events; self-selection is severe (concerned users look repeatedly, out-of-control users stop looking), so average-effect estimates need stratification by engagement.
Where it stops holding
"No intervention power" is scoped to the session that already elapsed. A weak cross-session effect exists — awareness accumulating into norms, comparisons generating goals — but it is small and depends on prior motivation; the report is not self-starting fuel but a spark that requires the user to bring their own. Where an external enforcement mechanism exists (the system automatically enforcing a limit on top of the statistics), the statistics serve as enforcement input rather than as the intervention itself — a different category of thing.
Applying it
Position statistics explicitly as the awareness layer, paired with timing components (session-start prompts, in-session friction, hard limits) to form an intervention chain. Reports should present actionable items ("Evenings are heaviest — set a nighttime reminder?") rather than stop at data display. Do not let "show users their data" stand in as the intervention strategy in a design. Verification: contrast a report-only condition against "report plus session-level prompts"; the increment is statistics' solo contribution — typically far smaller than the full intervention's effect, and that gap belongs in the feature's stated expectations.
Related
- Same group: P3.09.1 Time spent is not harm; purpose says more than volume · P3.09.3 The effective intervention point is session start, not mid-session · P3.09.4 Friction must exceed impulse yet stay below genuine need
- Adjacent: P3.04.1 Usage-time statistics provide self-knowledge · P3.03.2 Prompting users to leave is a viable design choice
- Search terms:
feedback intervention·retrospective feedback·just-in-time intervention