P1.07.5Novice-expert evaluation divergencedesignresearch

Proficient and new users judge the same element in opposite ways

Aliases: novice-expert differences · evaluation divergence · proficiency-based segmentation · onboarding animation

What it is

The same emotional element receives opposite verdicts: a tutorial animation is a necessary map to the novice and a forced rerun to the proficient; a heavy celebration reads as recognition to the novice and as being treated like a child to the proficient; instructional copy is a helper to one and waffle to the other. This novice-expert divergence is not a few fussy users — it is a function of proficiency, and since real user populations are almost always mixed while the interface ships only one version, the divergence is built into the interface itself, not a temporary state that will fade.

Why it happens

The verdict is set by two variables: exposure count and current goal. Novices are learning: expression carries information, its duration is learning time, repetition is consolidation, and the hand-holding weight matches their need. Proficient users are doing: expression blocks the goal, its duration is pure interception, repetition carries no information, and what remains is a hint restated on every pass — "the system still does not know you." The same tutorial animation hands the novice a map and hits the expert as a roadblock, because the expert has owned the map for months. Shift the goal state and the same stimulus slides from the positive pole of the rating scale to the negative one. This also explains why backlash against such elements clusters "after a while of use": the element did not change; the population judging it did.

Studying it

Two paradigms dominate. Cross-sectional comparison: give the same element to users at different experience levels, measure delight and interference ratings, compare the rating structure across segments. Longitudinal tracking: re-rate the same element with the same users as their tenure grows, tracing how the verdict migrates with proficiency. The expertise research tradition offers a directly transferable finding: the weights of aesthetic judgment shift systematically with expertise — novices weight familiarity and legibility, experts weight novelty and complexity — and interface-element divergence can be read as that regularity applied to interaction materials. Typical independent variables are exposure count, usage tenure, and task goal state (learning vs. doing); dependent variables are delight and interference ratings, skip rate, and usage of the in-settings opt-out. Three methodological traps: attrition bias — the proficient users who remain are precisely the tolerant ones, so cross-sectional comparison overestimates proficient users' acceptance; cross-sectional designs confound exposure count with cohort differences, which only longitudinal tracking can separate; and the lab cannot accelerate proficiency — "proficient" after a few sessions means "has seen it a few times," a different variable from proficiency formed over months of use.

Where it stops holding

"Opposite" is not universal: low-intensity elements produce no divergence, and the divergence grows with the element's expressive intensity and how directly it addresses the user — heavy celebration diverges far more than a micro-animation. Populations are internally heterogeneous too: long-term users include people who enjoy the ritual (veteran players and their unboxing animations), so segmentation should be an option, not a hard rule. Scene moderates the amplitude: sharpest in professional tools (every second is work time), weakest in entertainment products (the emotion is the point of use).

Applying it

  • Segment expressive intensity by proficiency: onboarding and welcome elements are visible on first use and then gone; celebration elements carry an occurrence cap and go silent past it.
  • Offer "open in proficient mode": condensed interface, onboarding skipped, shortcut paths — so the proficient never pay the novice tax twice.
  • Make the segmentation state reversible: after a major redesign, expressive intensity resets once, because the redesign reset everyone's proficiency.
  • To validate: compare delight and interference ratings plus skip rate for the same element across tenure segments (not exposure counts); interference in the proficient segment significantly above the novice segment's, or a proficient skip rate near its ceiling, triggers segmentation or retirement of the element.

Related

  • Same group: P1.07.1 Emotional elements usually add time cost · P1.07.2 High-frequency paths favor efficiency · P1.07.3 Low-frequency emotional scenes may tilt toward experience · P1.07.4 Skippability decides whether the conflict exists · P1.07.6 Emotional elements cost attention, not just time · P1.07.7 Efficiency itself is an emotional source in some scenes
  • Nearby: P1.02 Delighters · P1.05.6 Personality expression must decay in intensity with user familiarity
  • Search terms: novice-expert differences · expertise · aesthetic judgment

Cards in the same group

Quick Actions

Share

Share this page

ios_share

https://hci.top/en/handbook/P1.07.5