Signals from different senses must fall inside one narrow window to fuse

What it is

Signals from different senses fuse into one event only if they arrive within a fairly narrow window. Measured in tens to a few hundred milliseconds, that window determines whether the brain treats them as one event or two. It is the precondition for multichannel feedback being experienced as a single action outcome.

Why it happens

The window reflects the brain's inference about common origin: physically, the signals of one event arrive close together in time, so temporal proximity is used as evidence for a shared source. Integration brings gains such as better detection and localization, paid for with reduced sensitivity to the offset itself—which is why users are poor at noticing channel misalignment inside the window. The window is also plastic: repeated exposure to a fixed offset widens it in that direction, making an offset imperceptible that once was not. This explains why users adapt to steady delay but not to jitter.

Studying it

Simultaneity judgment is standard: have participants judge whether two signals were simultaneous while offset is varied systematically, deriving the point of subjective simultaneity and the judgment boundary that estimates window width. Variables include the channel pairing, stimulus intensity, attention, and prior exposure. Outcomes include the subjective simultaneity point and boundary width. Report whether a fixed offset was adapted first, since that shifts the estimate.

Where it stops holding

Training or long exposure widens the window, so laboratory estimates do not transfer to users already adapted to a specific device. If the two signals differ greatly in kind—scent versus vision, say—integration does not occur at all and the window concept does not apply. Directing attention to one channel also moves the boundary.

Applying it

• Keep the channels of a single event inside the integration window, typically targeting tens of milliseconds.
• Avoid random jitter, since a stable offset can be adapted to while jitter is continually perceived as two events.
• When a channel cannot fall inside the window, present it explicitly as a separate event rather than expecting fusion.
• Verification: measure the width of the "simultaneous" boundary and confirm actual latency falls inside it; reports of two events mean the window has been exceeded.

Related

• Within the group: D4.06.2 Signals beyond the window are perceived as two separate events · D4.06.3 Window width differs by sensory pairing
• Adjacent: D3.04.1 Haptics leading vision is more acceptable than lagging it · D4.05.1 Mismatch between visual motion and vestibular input causes discomfort
• Search terms: temporal binding window · multisensory integration · simultaneity judgment