Multichannel information should point at one interpretation

What it is

Information across channels should support one interpretation. When vision, hearing, and touch occur together, users fuse them into a single event, and fusion increases certainty only if the channels agree. When they imply different conclusions, users do not get more information—they get a contradiction they must resolve themselves.

Why it happens

The benefit of integration comes from reliability-weighted combination: each channel offers independent, noisy evidence, and the merged estimate is more accurate. That mechanism presumes the channels describe one event. Once they disagree, weighting is meaningless; users fall back on a single channel and pay an extra interpretive cost. In interfaces, disagreement often appears subtly—animation moving one way while sound implies another, haptics out of step with on-screen text—and such differences are enough to undermine confidence in the system.

Studying it

Use congruence manipulation: make channels agree or deliberately conflict, then measure judgment accuracy, reaction time, and rated system reliability. Variables include the conflicting channel pair, conflict magnitude, and task type. Include subjective confidence, since congruence affects not only accuracy but the user's trust in their own judgment.

Where it stops holding

Congruence is not duplication. Complementary relations—each channel supplying different but compatible information—do not violate it, provided all of it fits one interpretation. When a channel is inherently limited, as haptics restricted to binary states, the requirement should be stated as "must not contradict the primary channel" rather than "must express the same content."

Applying it

• Check item by item whether the channels of one event imply compatible conclusions, especially regarding direction, timing, and degree.
• State the expressive limits of constrained channels so they do not imply content the primary channel never conveyed.
• For complementary relations, ensure the pieces fit one interpretation instead of forcing users to switch frameworks between channels.
• Verification: build congruent and conflicting versions and measure accuracy and reliability ratings; a clear drop means the current design is inconsistent.

Related

• Within the group: D4.04.2 Vision usually dominates when channels conflict · D4.04.3 Conflict lowers overall credibility
• Adjacent: D3.04.2 De-synchronization weakens the sense of direct manipulation · D5.01.2 Complementarity divides different kinds of information
• Search terms: multisensory congruence · cross-modal consistency · reliability weighting