Avoid double negatives and double-barreled items
Aliases: double negative · double-barreled question · two questions in one
What it is
A double negative stacks two negations, or a negation plus a reversal, in one stem—“Do you disagree that you never save passwords.” Miss one layer and the submitted option flips relative to the intended meaning. A double-barreled question puts two separable propositions into one response slot—“The interface is clear and fast.” The resulting number cannot be unpacked into clarity, speed, or some mix of both. Both item types break the item–answer mapping: the first can reverse direction; the second can fuse objects. They are structural errors, not a wording style.
Why it happens
Working memory does not stably perform two logical operations at once. Each “not / never / oppose” in the stem flips a truth value; missing one layer wires the scale backwards, and later aggregates count opposition as agreement. A double-barreled item forces a private weighting between two propositions: some people score the worse half, some the more salient half, some an average. The researcher receives an irreversible blend and still interprets it as one construct. Conjunctions such as “and / as well as / at the same time” are the structural tell: one slot, two truth values, information already unrecoverable at submit.
Studying it
In pretest, split a suspected double-barreled item into two, and compare the split items’ correlation, score gap, and inconsistency with the original fused score. Low correlation or a large gap means the original mixed objects. For double negatives, have respondents restate the stem in their own words and point to which layer they are agreeing with; code missed negations. High-load settings (mobile, time pressure, non-native language) belong as strata, not as noise inside a grand mean. A repaired questionnaire should be retested on the same people so a distribution shift can be attributed to the structural fix rather than a new sample.
Where it stops holding
Legal or safety source text sometimes must keep nested “must not unless” logic; that is the source’s logic, not a survey invention. Those items should become scenario choices or stepped confirmations, not agreement scales. An “and” that names one indivisible action (“Save and close” as a single command name) is not automatically double-barreled; the test is whether a respondent can endorse only one half. A reverse-scored item with a single negation is not a double negative; its extra load is a separate issue.
Applying it
- Circle every negation in each item; if there is more than one, rewrite as an affirmative statement, or split into “did it happen” plus a separate evaluation.
- On every “and / as well as / at the same time,” test whether each half can be true alone; if yes, split into two items and never share one number.
- In pretest, have someone who did not write the items hear the stem without options and say how many things they are answering; two things means the item goes back.
- Do not continue a historical double-barreled item as a trend point: do not splice it onto the split replacements; start a new series and mark the break.