V2.05.3Telepointer lagdesignresearch

Delayed cursor updates make spoken reference miss its target

Aliases: cursor latency · pointing lag · deictic misalignment

What it is

Telepointer lag occurs when a displayed collaborator cursor trails the operator's actual target. Spoken “here” and pointer movement form a joint event; if channels arrive at different times, the addressee binds speech to an old position even when both eventually arrive. A stable offset may be learned, while jitter and reordering resist prediction.

Why it happens

Audio, pointer events, and content state travel through different transport and rendering pipelines. Sampling, throttling, network queues, interpolation, and frame rendering add variable delay; scrolling and reflow alter the coordinate frame. Addressees use temporal proximity to bind voice and location, so reordering creates false pairing. Smoothing can add buffering, improving motion appearance while worsening deictic timing.

Studying it

Manipulate audio and pointer delay, jitter, and loss independently; measure first-click accuracy, localization time, clarification, and perceived synchrony. Instrument end-to-end presentation rather than network round-trip alone and include scrolling and layout changes. Compare stable delay with random jitter because identical means do not imply equal predictability.

Where it stops holding

No universal millisecond threshold applies across task speed, target density, and labels. Asynchronous annotation replaces synchrony with anchoring concerns. Sending a high-frequency precise trail to minimize lag also costs bandwidth and exposes reading behavior.

Applying it

  • Put audio, pointer, and canvas events on a common time base and monitor receiver-side presentation delay.
  • Under poor connectivity, reduce trail detail while preserving click endpoints and disclose degraded quality.
  • Convert consequential pointing into a persistent highlight or object marker.
  • Test first-location accuracy and repair under combinations of delay, jitter, and scrolling.

Related

  • Same group: V2.05.1 Cursors need identity labels · V2.05.2 Color alone fails at scale · V2.05.4 Many cursors obscure content · V2.05.5 Cursor sharing exposes reading position
  • Adjacent: V2.04 Shared reference · V3.06 Consistency under network latency
  • Search terms: telepointer lag · cross-modal synchrony · network jitter

Cards in the same group

Quick Actions

Share

Share this page

ios_share

https://hci.top/en/handbook/V2.05.3