Presenting the same information through both visual and verbal channels can raise working memory's effective capacity

What it is

The same content, presented purely through text or speech versus split into a complementary verbal part and a visual/spatial part presented together, leaves users able to actually retain and use different amounts of information — the latter usually holds up better. This isn't because some storage ceiling inside working memory got stretched; it's because the load is now spread across two independent channels' storage space instead of being piled entirely into one. This is sometimes described as dual coding playing out at the working-memory level.

Why it happens

The phonological loop and the visuospatial sketchpad are two relatively independent, each individually limited storage resources. If a piece of information is presented entirely in verbal form, it can only occupy the phonological loop's channel. Recasting a complementary part of it as visual or spatial content instead routes part of what would have been crammed into one channel onto a second channel, so each channel only has to carry part of the load. Since the two channels barely compete for each other's resources, the split total load is easier to hold onto simultaneously than the same load stacked into a single channel — this is a structural gain from using two independent storage slots, not an expansion of either channel's own limit.

Studying it

A common way to test this effect is to compare retention or recall performance for the same content under a "purely verbal presentation" condition versus a "verbal plus complementary visual/spatial presentation" condition, with presentation format as the independent variable and recall accuracy or task error rate as the dependent variable. A key methodological point in this kind of research is confirming that the visual and verbal parts are genuinely complementary, each conveying a different facet of the same information, rather than being redundant repetition or unrelated content — otherwise any measured difference could just reflect a change in total presented volume rather than the dual-channel split itself.

Where it stops holding

This benefit assumes the two channels are genuinely, independently carrying complementary content. If the so-called "two channels" are actually both verbal in nature (written text presented alongside a spoken reading of the same passage, say), both still compete for the phonological loop, and no splitting effect occurs. If the visual/spatial part and the verbal part say different things and require extra cross-checking to reconcile (a diagram that doesn't match what the text says, for instance), the user has to bring the central executive in to coordinate and integrate the two, and that coordination overhead can cancel out or even outweigh the gain from splitting the load.

Applying it

• When the amount of information a user needs to hold temporarily exceeds what a single channel can comfortably carry, consider splitting the content into complementary verbal and visual/spatial parts presented together (a spoken instruction paired with a persistently visible diagram, say) rather than repeating the same content within one format to reinforce it.
• Make sure the content given to the two channels is genuinely complementary and non-conflicting, so the user doesn't have to spend extra effort checking whether the two agree — the design goal is to save coordination cost, not add a verification step.
• Don't treat "multimedia presentation" as simply "doubling the information": if the two channels actually convey a repeated expression of the same thing, this benefit doesn't materialize — it just consumes more screen space and attention.
• Verification: for the same piece of critical information, design a pure-verbal version and a verbal-plus-complementary-visual version, and test recall accuracy or task completion after a brief delay or interruption. If the dual-channel version performs noticeably better, the split is genuinely working; if there's no difference or it performs worse, check whether the two channels' content is actually complementary.

Related

• Same group: A6.12.1 The phonological loop holds verbal and numeric information · A6.12.2 The visuospatial sketchpad holds visual and spatial information · A6.12.3 The two subsystems draw on relatively independent resources, so simultaneous information in different channels doesn't interfere · A6.12.4 The central executive coordinates the subsystems and allocates attention, and has its own capacity limit
• Nearby: A6.02 Working memory capacity
• Search terms: dual coding · modality effect · multimedia presentation