Z2.04.2Misidentification as a data-leak pathdesignresearch

Misidentification leaks other people's data

Aliases: misidentification · cross-account disclosure

What it is

The consequence of an identification error is not "degraded experience" — it is a data incident: mistake A for B, and B's data flows to A — calendars, messages, preferences, health records. Mistake a stranger for the owner, and the owner's privileges are handed over. Misidentification is a data-leak path, in the same class as unauthorised access in traditional security, except the entry point is a recognition error instead of a vulnerability.

It also has the property that lets incidents multiply: it is invisible to the exposed party. B never learns that their calendar was just announced to a guest — nothing to notice, nothing to complain about, nothing to correct. The exposure repeats silently until chance reveals it.

Why it happens

Recognition in shared spaces is inherently multi-subject: family members resemble each other in face and voice (parents and children, siblings especially), visitors enter temporarily, and recognition conditions (lighting, angle, distance) drift continuously — misidentification is a daily event, not a tail risk. Three paths convert it into exposure:

  • Cross-account disclosure: the system renders whoever it recognises — the son's calendar announced to a guest in the living room, the wife's private reminder cast to the misidentified screen.
  • Privilege inheritance: recognised as the owner means inheriting the owner's rights — unlocking, disarming, viewing recordings. A recognition error is translated directly into a breached security boundary.
  • Log contamination: the misidentified person's behaviour is filed into the identified person's record — health and behaviour profiles drift wrong over long periods, undetected. This third path is the stealthiest: analytics draw wrong conclusions from wrong profiles ("mother's night activity is unusual" — actually the daughter).

Studying it

  • Multi-user smart home research: Zeng, Mare and Roesner's 2017 survey of smart home users found data isolation and access control in multi-user settings to be a core concern — who gets to see whose data is a first-order user problem, not an edge feature.
  • Misactivation records: cases of voice assistants being triggered by television audio, other people's voices, and broadcast advertisements — and then acting — recur in public reporting and independent measurement (safe to state generally), demonstrating that non-enrolled voices genuinely pass recognition.
  • Cross-population error disparity: the face-recognition literature extensively documents uneven error rates across groups (stated generally); transposed into the home, the probability of being misidentified is not uniform within a household.

Methodological caution: exposure incidents via misidentification go essentially unreported in natural use (the exposed party is unaware); research relies on deliberate construction — scripted scenarios (family members swapping places, guests entering) followed by log audits, tallying misidentification and disclosure rates.

Where it stops holding

  • Exposure = recognition error rate × data sensitivity. Low-sensitivity data (lighting preferences) carries light consequences; decide whether to fix by pricing this product first — not every misidentification deserves investment.
  • "Same household" is not a trust boundary. Real privacy boundaries exist inside homes — teenagers from parents, flatmates from each other, nannies from employers; a design treating the home as one trust domain turns every misidentification into a cross-domain leak.
  • Guest-scenario misidentification is the most dangerous. A stranger recognised as the owner inherits privileges outright; the reverse (owner taken for a guest) is merely an experience problem — the two directions differ completely in cost.

Applying it

  • When recognition confidence is low, disable sensitive-data rendering and privilege inheritance: degrade to generic behaviour (generic greeting, no personal content) — better bland than disclosed.
  • Default announcements and displays on multi-user devices carry no personal information: what may be said with someone present is tiered by content sensitivity; the most sensitive goes only to channels confirmed to the person themselves (phone, not speaker).
  • Privilege actions (unlocking, disarming) require independent authentication or a whitelist — recognition as sufficient credential is reserved for low-sensitivity actions.
  • Tag logs with recognition confidence: low-confidence records go to a pending pool, not into personal profiles.
  • How to check: using family member A's voice/face, attempt to trigger member B's notifications, announcements, and privileged actions, recording each success. Every success is a reproducible disclosure path.

Related

  • Same group: Z2.04.1 Detecting someone present is not knowing who · Z2.04.3 Visitors and temporary occupants need a default policy
  • Nearby: Z2.02 The uncertainty of inference · Z6.03 Privacy in shared spaces
  • Search terms: misidentification · data leakage · multi-user smart home · voice assistant misactivation

Cards in the same group

Quick Actions

Share

Share this page

ios_share

https://hci.top/en/handbook/Z2.04.2