Hand-role binding requires continuous correct left-right identification; errors swap functions

What it is

Pinning the menu to the left hand and the tool to the right bets the product's meaning on always knowing which hand is which. When left-right misclassification occurs, the user still moves their own body, but the left hand's motion is delivered into the right hand's command channel: a function swap. The symptom is not silence. It is “I did the right motion and the other side's function ran”—the menu hand starts a drag, or the confirm hand issues cancel.

Why it happens

A single camera infers laterality from position relative to the torso, thumb orientation, and continuity with the previous frame's labels. Crossing the arms, working behind the back, a camera that sees from rear-oblique, a mirrored preview, or a glove that hides the thumb can invert those cues. Skeleton trackers swapping left and right labels after a crossing is a textbook depth-camera failure: last frame's “left hand” becomes this frame's spatial right hand. If the product does not re-validate at the crossing, bound functions follow the labels and the user sees an object “stolen” by the other hand. Inside-out headset tracking of one's own hands is relatively stable; third-person cameras, desktop depth modules, and phone rear cameras flip laterality easily.

Studying it

Have participants complete a bound task under crossed arms, hands close together, turning, and one hand briefly leaving then re-entering the frame. Record the fraction of frames whose left-right labels disagree with ground truth (markers or hand labels), and whether those frames produced a function swap. Separate “label wrong but no command issued” from “label wrong and the command took the wrong channel.” Test mirrored displays on their own: proprioception disagrees with screen left-right and inflates how severe a swap feels.

Where it stops holding

If laterality is not bound and either hand fires the same command, misclassification has no functional cost, only a bookkeeping one. Deciding left versus right once when a hand enters, then riding continuity, can suffice for a seated task that never crosses, but it will not survive a single crossing. Surgical gloves, dark cuffs, residual limbs, and prostheses remove thumb-orientation cues. Children's hands stay closer and cross more often; adult laterality accuracy does not transfer.

Applying it

• When the hands are too close or crossed, suspend role-bound commands and fall back to a safe either-hand subset so a swap cannot execute.
• Give swapped functions a channel-visible cue (one sound or left-side light for left-hand commands, another for right) so the user immediately sees “the system inverted my hands.”
• Acceptance scripts must include crossing, side stance, and gloves. The metric is swapped executions, not overall gesture recognition rate.

Related

• Same group: C4.18.1 Some systems bind functions to the left or right hand, giving the other hand a different role · C4.18.3 Independent bimanual operation requires separate onset, offset, and engagement state machines · C4.18.4 Handedness differences mean default left-right bindings may not fit left-handers
• Adjacent: C4.13 Full-body pose and skeleton tracking · C4.17 Input attribution and multi-user arbitration
• Search: hand laterality · left-right swap · skeleton label switch