Z1.01.2Legibility of invisible systemsdesignresearch

Invisibility removes controllability and diagnosability

Aliases: silent failure · system legibility

What it is

The other side of disappearance: a system that goes unnoticed cannot be controlled or diagnosed by its users. Control presupposes knowing that something is running — what is unknown cannot be started, stopped, or configured. Diagnosis presupposes observable behaviour — without symptoms to observe, faults cannot be attributed. The property at stake is the system's legibility: whether users can read, from the surface the system offers, what it is currently doing.

The most dangerous form is the silent failure: an automation executing wrongly is indistinguishable from executing correctly — both look like "nothing happened" — and the error surfaces only through its physical consequences: the underfloor heating on for a week, the door that never locked, the camera that has been recording all along.

Why it happens

Control is a loop: perceive state → judge → act → observe outcome. Disappearance severs the perception end — with no observable expression of current state and changes, judgement and action have no starting point. This is not a usability problem but a loop-integrity problem: the finest control affordance is useless if the user cannot tell what is happening now.

Diagnosis fails one level deeper: localising a fault requires mapping symptoms onto components (sensor? network? rule?), and that mapping needs the system to expose its internal layering. An invisible system offers no symptom surface, so users must reason backwards from physical-world consequences to internal state across several layers of inference — misattribution is close to guaranteed.

A slower channel compounds this: the user's mental model loses its updating input. Models are calibrated by feedback; invisibility means no feedback, so the model freezes at installation time. Meanwhile the system keeps evolving — firmware updates, rules piling up, a family member changing settings — so the gap between model and reality only grows, until a failure exposes it and the user is left diagnosing today's system with a months-stale model.

Studying it

  • Awareness studies: ask users to describe what their system currently does — which automations are active, under what conditions — and compare against backend logs to establish a baseline. In smart-home field studies, users under-reporting their appliances' actual energy use and their active automations is a robust finding.
  • Attribution interviews: after a failure, have users reconstruct "what did you think the problem was" and compare with the actual failing layer, yielding misattribution rates and localisation path lengths. Edwards and Grinter's analysis of the challenges of moving ubiquitous computing into real homes lists managing invisible technology among the core obstacles.
  • Deployment comparisons: run the same system in a "state queryable" version and a "fully invisible" version over long deployments, comparing fault-detection latency, user intervention success, and trust scales.

One methodological caution: do not inject faults only in the lab. Real domestic failures are sporadic, span layers, and entangle with life events; retrospective interviews with households that have lived through genuine failures come closer to the actual diagnostic process than manufactured ones.

Where it stops holding

  • The harm of invisibility concentrates at failure time. During normal operation invisibility costs almost nothing — precisely what makes it attractive. Any evaluation of invisibility must include failure scenarios; testing only normal operation yields the false conclusion that invisibility is free.
  • Loss of control is not attributable to invisibility alone. Complexity and abstraction are independent sources — a system can be fully visible yet unreadable. The two compound (invisible and incomprehensible) into the least recoverable state; keep the two causes distinct in analysis and in evaluation.
  • Small systems are carried by memory. With one device and a couple of rules, users compensate from installation memory; past a dozen devices and rules, memory compensation fails and the invisibility debt starts accruing.

Applying it

  • Keep a discoverable running entry point for every automation: never interrupting, but always answerable to "what is happening right now" — a list of currently active rules with each one's last trigger time.
  • Keep an after-the-fact history of key state changes even without live display; fault localisation runs on timelines, not on attention at the moment.
  • Put an exit at the point where a silent action's consequence surfaces: when the user notices "the light switched itself off", the answer — which automation did it, and how to turn it off — must be reachable right there. A support-ticket-style hunt hours later is no exit at all.
  • How to check: quiz users on "how many automations are currently active in your home" and score the hit rate; run one fault drill and measure the time from symptom to correctly localised layer (device / network / rule). If those two numbers fail, disappearance is borrowing against controllability.

Related

  • Same group: Z1.01.1 Mature technology weaves itself into the environment and stops being noticed · Z1.01.3 Disappearance and comprehensibility are a fundamental tension
  • Nearby: Z1.05 The costs of invisible computing · Z7.02 Fault diagnosis
  • Search terms: legibility · silent failure · smart home troubleshooting · at home with ubiquitous computing

Cards in the same group

Quick Actions

Share

Share this page

ios_share

https://hci.top/en/handbook/Z1.01.2