A single measurement captures momentary or episodic experience and cannot be extrapolated to long-term experience

What it is

One test or one questionnaire captures only the scale present at measurement time: a lab session yields momentary and episodic data; a one-shot survey yields the attitude of the moment of filling it in. Reading either as a verdict on "long-term experience" is extrapolation—long-term experience is shaped by repeated use, habituation, and changing circumstances, none of which a single measurement can see.

Why it happens

Extrapolation fails because long-term experience has components a single shot cannot touch: novelty decay (the dazzling interface becomes ordinary by the thirtieth use), habituation (the initially annoying operation becomes muscle memory), accumulating burden (individually tolerable frictions stacking into a churn reason), and life-context change. These components have time constants from days to months; a single measurement's time constant is zero. Conclusions therefore carry a shelf life and conditions—"the evaluation at this freshness level, in this context"—and citations beyond that range describe a different object.

Studying it

The remedy is to make longitudinal evidence mandatory for long-term claims: repeated-measurement designs (the same users scored in week one, month one, quarter one), cohort retention analysis, and long-run diaries. Under budget constraints, proxy signals substitute partially—retention and return curves, frequency drift, feature abandonment rates—declared in reports as indirect proxies, not direct measurement. Single measurements still earn their keep—locating concrete problems and early experience—but their reporting frame stays separate from longitudinal data.

Where it stops holding

Not every conclusion needs longitudinal data: structural defects (an invisible button) are confirmable in one test and do not change with time. Longitudinal measurement has biases of its own—retained users are not satisfied users (the departed cannot fill in surveys), and panel attrition distorts trajectories. For very low-frequency products, the "long-term" window counts real uses, not calendar time.

Applying it

• Give the experience-conclusion template an "evidence expiry" field: single-shot findings carry a validity range, renewable only with longitudinal evidence.
• Stand up fixed longitudinal tracking for the core experience (say, three scores in a new user's first month), funded partly by trimming one oversized one-shot study.
• Check staleness before citing old measurements: after a major redesign or past the set expiry, they stop counting as evidence about current experience.

Related

• Same group: B5.12.1 Experience splits into anticipated, momentary, episodic, and cumulative time scales, and conclusions cannot move across scales · B5.12.2 Remembered experience is dominated by peaks and endings, inconsistent with the average of momentary experience · B5.12.4 First-use experience and long-term experience often call for opposite optimization directions
• Nearby: Q4 Measurement and Reliability · B5.03 Learnability
• Search terms: longitudinal study · novelty effect · habituation