U8.02.1Whether an error bar shows standard deviation, standard error, or confidence interval must be stateddesignresearch

The same-looking error bar can mean standard deviation, standard error, or a confidence interval — it must say which

Aliases: error bar semantics · interval type annotation

What it is

"Error bar" as a visual element does not carry a unique statistical meaning—an error bar of the same length may represent the standard deviation (how much the data itself varies), the standard error (how precisely the mean is estimated), or a 95% confidence interval (the range where the true value falls with 95% probability). The numerical differences among the three can be several-fold (for n=100, the 95% CI is roughly twice the standard error, while the standard deviation is roughly ten times the standard error). A reader who misreads a standard deviation as a confidence interval mistakes data variability for estimation precision, arriving at overly optimistic or overly pessimistic conclusions. Leaving the type unlabeled lets each reader guess the meaning—and guesses vary by reader.

Why it happens

The misreading stems from three statistics answering different questions while sharing one visual form. "How much does the data vary?" is answered by the standard deviation. "How precise is the mean estimate?" is answered by the standard error (SE = SD/√n). "Where does the true mean plausibly lie?" is answered by the confidence interval (roughly SE × 2). These three questions correspond to three different decisions: judging process stability uses SD, judging estimate reliability uses SE, and judging threshold crossing uses CI. Faced with an unlabeled error bar, readers implicitly choose an interpretation based on their current task—someone judging against a threshold reads it as a confidence interval, someone assessing variability reads it as a standard deviation—while the chart maker may have drawn a third option. The task-semantics mismatch produces no visual conflict signal and surfaces only at the decision level as a wrong judgment. Research shows that even experienced readers' agreement on unlabeled error-bar meanings falls significantly below chance.

Studying it

The standard design for studying error-bar misreading is an interpretation task: present participants with the same data but error bars carrying different meanings (SD vs CI), and measure interpretation accuracy under different task instructions (judge whether two groups differ / judge the range of variation). Variables include the error bar's statistical meaning, annotation condition (none / text annotation / legend), and participants' statistical training. In real dashboard settings, user interviews or think-aloud protocols can reveal readers' default assumptions about error bars in existing charts. A methodological caveat: lab task instructions specify what to read, while in real use readers decide for themselves—instruction-condition accuracy overestimates real-use accuracy.

Where it stops holding

Annotation necessity depends on the reader population: statistically trained readers (e.g., academic reviewers) can infer error-bar meaning from context, but inference relies on field conventions (biology papers typically use SE, psychology typically CI), and cross-field reading still produces errors. For internal dashboards showing one statistic with clear context, a one-line caption may suffice; for systems mixing multiple statistics, per-chart annotation is non-negotiable. Interval expressions beyond error bars (bands, violin plots) need labeling too—the semantic-labeling problem is not unique to error bars.

Applying it

  • State the error bar's statistic in every chart's caption, tooltip, or axis label ("95% CI" or "±1 SD").
  • Prefer labeling confidence intervals over standard deviations: decision-facing charts need "where the true value plausibly lies," and the standard deviation answers a different question.
  • Establish a team convention: set a default interval type at the dashboard-system level, keep all charts consistent, and annotate only deviations.
  • Verification: sample 5 charts with error bars, cover the captions, and ask a statistically literate colleague what each error bar means; any mismatch above zero means annotation is insufficient.

Related

  • Same group: U8.02.2 Overlapping intervals between two groups do not imply a non-significant difference · U8.02.3 Interval width varies with sample size; sample size must accompany it · U8.02.4 Gradient bands create less certainty illusion than hard-edged intervals · U8.02.5 A band's visual width depends on the y-axis scale and cannot be compared across charts
  • Nearby: U8.01.2 Error bars and interval bands are the basic tools · U8.01.3 Omitting uncertainty claims certainty
  • Search terms: error bar semantics · confidence interval annotation · SD vs SE vs CI

Cards in the same group

Quick Actions

Share

Share this page

ios_share

https://hci.top/en/handbook/U8.02.1