Betting an irreversible or life-threatening risk on one safeguard is not enough
Aliases: defense in depth · redundancy · independent barriers
What it is
When the consequence of a slip is severe enough — irreversible data loss, physical harm, a system-wide outage — a single layer of protection, no matter how well it's designed, isn't statistically sufficient to bring the risk down to an acceptable level. This is a direct corollary of the Swiss cheese model: one layer still carries its own holes, and once it's punctured with nothing behind it to catch the failure, the probability of an accident equals that one layer's failure probability outright, rather than the product of several layers' failure probabilities. What a high-consequence operation needs isn't "make this one layer better" — it's "add another, independent layer."
Why it happens
Every layer of protection — an on-screen confirmation, a permission check, a physical interlock — carries its own non-zero failure rate: design oversights, deferred maintenance, use cases the designers never anticipated all cause a layer to fail at some point. With only one layer, the system's overall failure probability is roughly that layer's own failure probability. With two independent layers, the overall failure probability is roughly the product of the two, typically an order of magnitude smaller. This multiplicative relationship is where "many layers beat one" comes from mathematically, and it's why high-consequence fields — medication dosing, financial clearing, industrial control — standardly require at least two independent safeguards rather than trusting any single one to reach zero failures. Zero failure doesn't exist in engineering; what's achievable is making the joint probability of failure small enough.
Where it stops holding
The payoff from adding layers scales with the product of consequence severity and the probability of occurrence. For operations with minor, reversible, easily-undone consequences, the efficiency cost of stacking a second safeguard can outweigh the risk it removes, and a single layer — or none at all — is the more sensible choice. More layers isn't automatically better, either: past a certain point, a new layer that shares a failure cause with an existing one, or that itself introduces enough operational burden to trigger new active failures, cancels out its own benefit. Where exactly that boundary sits shifts with how much operational cost the organization can absorb.
Applying it
Start by grading operations on how severe and reversible their consequences are, and only require at least two independent safeguards for the operations graded high-consequence — resist the reflex to apply "multiple confirmation" uniformly across every scenario, which just saddles low-risk operations with unnecessary friction. When deciding whether an existing single safeguard is worth backing up with a second layer, favor a detection principle that's different in kind from the first — for an operation that already has an on-screen confirmation, add a system-side automatic check as the second layer rather than another manual confirmation, so a common-cause failure can't take out both at once. Verification: list every operation flagged as "irreversible" or "high-consequence" in the system and check the number and independence of its current safeguards one by one. Any high-consequence operation with exactly one safeguard — and where that safeguard is a single user-triggered action like a click to confirm — belongs at the top of the list to reinforce.
Related
- Same group: A10.07.1 layered defenses and hole alignment · A10.07.2 the distinction between active failures and latent conditions · A10.07.4 the model was built for accident analysis, and using it directly as a design method has limits
- Nearby: A10.08 error tolerance and graceful degradation · A10.06 error-proofing design
- Search terms:
defense in depth·redundancy·independent barriers