P3.09.2Retrospective feedback limitdesignresearch

Retrospective statistics have no power over use that already happened

Aliases: feedback intervention · just-in-time intervention

What it is

Usage reports are retrospective: they tell you last week took nine hours, but those nine hours already happened. The output of statistics is awareness — knowing — not intervention — stopping in the moment. Over use that has already occurred, a report exerts no direct force; deploying one as an intervention strategy mistakes the tool's category.

Why it happens

An intervention must enter the decision at the moment of behavior; the report arrives after the behavior ends, with an entire session in between. Everything it does is indirect: if the user cares about the data, the report can convert into a resolution before the next session — "today I'll hold back." But that resolution has no execution mechanism inside the session and offers no resistance to a gradually deepening state of immersion. Feedback's motivational effect also has a stable boundary: negative feedback (overrun), when unaccompanied by a strategy, tends to produce avoidance — not opening the report — rather than adjustment. None of this contradicts the cognitive value of statistics; it separates two distinct outputs. Knowing how long you used: the report delivers that. Being able to stop right now: statistics never supplied that.

Studying it

Feedback-intervention research: randomized experiments with behavioral logs as outcomes, varying feedback timing (immediate versus delayed), valence (positive versus negative), and accompanying strategies (goal setting, implementation intentions) as moderators. Methodological cautions: report open-rate is not feedback exposure — opening, reading, and understanding are three different events; self-selection is severe (concerned users look repeatedly, out-of-control users stop looking), so average-effect estimates need stratification by engagement.

Where it stops holding

"No intervention power" is scoped to the session that already elapsed. A weak cross-session effect exists — awareness accumulating into norms, comparisons generating goals — but it is small and depends on prior motivation; the report is not self-starting fuel but a spark that requires the user to bring their own. Where an external enforcement mechanism exists (the system automatically enforcing a limit on top of the statistics), the statistics serve as enforcement input rather than as the intervention itself — a different category of thing.

Applying it

Position statistics explicitly as the awareness layer, paired with timing components (session-start prompts, in-session friction, hard limits) to form an intervention chain. Reports should present actionable items ("Evenings are heaviest — set a nighttime reminder?") rather than stop at data display. Do not let "show users their data" stand in as the intervention strategy in a design. Verification: contrast a report-only condition against "report plus session-level prompts"; the increment is statistics' solo contribution — typically far smaller than the full intervention's effect, and that gap belongs in the feature's stated expectations.

Related

  • Same group: P3.09.1 Time spent is not harm; purpose says more than volume · P3.09.3 The effective intervention point is session start, not mid-session · P3.09.4 Friction must exceed impulse yet stay below genuine need
  • Adjacent: P3.04.1 Usage-time statistics provide self-knowledge · P3.03.2 Prompting users to leave is a viable design choice
  • Search terms: feedback intervention · retrospective feedback · just-in-time intervention

Cards in the same group

Quick Actions

Share

Share this page

ios_share

https://hci.top/en/handbook/P3.09.2