Decision-makers systematically underestimate uncertainty in long-term effects
Aliases: long-run overconfidence · narrow long-term interval · false precision
What it is
On what will happen months later, decision-makers often give more confidence than the evidence allows. That is underestimated long-term uncertainty. Short-window numbers are clear and the story is complete, so “the long run will probably look similar” is spoken as near-certainty; the real interval—whether novelty fades, whether trust is overdrawn, whether a competitor changes the game—is demoted to a footnote. The underestimation is not occasional optimism. It is the clarity of short evidence being mistaken for the clarity of a long process.
Why it happens
People let currently available information stand for the whole trajectory. Short-window charts are concrete, projectable, and slide-ready; long processes offer only a mechanism story and a wide interval. The concrete outranks the wide, so confidence follows the concrete. Organizations also reward predictions that sound settled: “it will still be good in three months” passes a meeting more easily than “the sign in three months is uncertain.” Rewarded certainty copies itself, and even researchers draw the interval tight to keep a seat at the table. The consequence is that risk management disappears: if it is treated as certain, a holdout is not worth keeping, a rollback is not worth buying, delayed payout is not worth waiting for. After uncertainty is underestimated, someone has not merely miscomputed variance; variance has been removed from the agenda.
Studying it
Collect spoken or written confidence about long-term effects in meeting materials (point forecasts, no interval, or a very tight interval) and compare with realized values at the due date; check whether calibration is systematically overconfident. A judgment experiment also works: give decision-makers the same short-window result, require one group to write a three-month interval and the other only a point, and compare later coverage. Code where language such as “definitely,” “won’t be a problem,” “same in the long run” appears in meetings; it usually follows the short-window chart. Separate underestimation from mere directional error: the direction can be right and the interval still too tight.
Where it stops holding
Some long processes are tightly constrained (physical performance, statutory flows), and uncertainty is genuinely low; insisting on a wide interval is performed humility. Underestimation is also not an argument for waiting forever: when action is required, the right move is to act with a wide interval and keep options, not to pretend a point forecast. Researchers who draw the interval so wide that any outcome can be called “within expectation” create another unfalsifiable claim, equally useless.
Applying it
- Materials that claim a long-term effect must give a due date and an interval, not only a point; without an interval they must not be written as “long-term evaluated.”
- In the meeting, read the interval before the point; a point-only forecast is an incomplete evaluation.
- Bundle “keep a holdout / remain rollback-able / delay payout” as options that travel with a wide interval, in the same decision.
- At the due date, compare the then-stated interval with the realized value, and calibrate next meeting’s confidence; do not only celebrate a correct direction.
Related
- Same group: Q6.10.1 Organizational evaluation cycles are usually shorter than the time UX harm takes to appear · Q6.10.2 A long-term holdout that never receives the change is a common way to observe long-term effects · Q6.10.4 Short-term metric gains bought with manipulative design erode long-term trust
- Adjacent: Q6.06 Long term and short term · Q3.13 Statistical significance and practical significance
- Search terms:
long-term uncertainty·overconfidence·forecast calibration