G3.02.1query formulationdesignresearch

Queries users type are typically short and imprecise

Aliases: short queries · imprecise queries · query construction

What it is

What people actually type is usually two or three words, and those words rarely match the exact title in the index. That is the normal state of query formulation, not users being careless. Furnas’s vocabulary problem already said: many names attach to one object, and the first word a given person thinks of is unlikely to be the one the system chose. Query-log length distributions stay short; imprecision is the companion of shortness—few tokens leave few constraints for disambiguation.

Short-and-imprecise describes the string that gets submitted. It does not explain why Boolean syntax goes unused, and it does not require the engine to parse full spoken sentences; those are neighboring problems.

Why it happens

A “good enough” query demands three jobs at once: extract a typeable attribute from the target, translate it into a word the system might know, and decide how specific to be. Working memory does not hold the finished product of all three, so people stop at the cheapest version—usually the first two or three words that surface. Site search makes this sharper: the collection looks small, so “reimburse” ought to uniquely mean that policy, and people do not add “travel,” “2024,” or “finance.”

Imprecision has other sources: memory of a situation rather than a label (“the one that needed a stamp last time”), or of a fragment (“something about travel”). Once a short query hits ranking, a high-scent popular item can bury the rare item actually remembered. It looks like a ranking bug; the query simply did not supply enough distinctiveness to beat popularity. Designing as if users will type the full title pushes the whole cognitive cost of formulation back onto them.

Studying it

Measure what real queries look like before deciding which layer the interface should add.

  • Paradigms: query-log analysis (token count, share of unique queries, reformulations inside a session); known-item tasks that give a situation but not the canonical title, scoring overlap between the first query and the target title; Hearst’s contrasts of Web versus site-search query length.
  • Independent variables: whether the task provides the canonical name, visible hints about collection size, whether query suggestions offer a longer phrasing to borrow.
  • Dependent variables: length of the first query, whether it hits the target, whether later queries lengthen or swap words, whether failure is blamed on “nothing there” or “I used the wrong words.”
  • Methodological note: a lab task sheet that prints the full target name lengthens first queries and fakes a “precise” distribution. Use field logs or situation-only tasks. Mean length hides bimodality (tiny navigational queries vs slightly longer topical ones); report by task type, not one average.

Where it stops holding

Users of expert libraries, legal retrieval, and command palettes write longer, identifier-like queries; the short-query assumption fails there. Voice input and pasted sentences suddenly get long; keep input channel separate in length stats. Forcing a minimum character count before submit does not make queries precise—it produces padding or abandonment. When the collection is keyed by unique IDs and users hold those IDs, a short query is precise: shortness is not imprecision; imprecision is the many-to-one map between words and objects.

Applying it

  • Design against the real length distribution, not an ideal query: default ranking should still be decidable from two or three words.
  • On the result page, expose material that can lengthen the next query (full titles, synonyms, owning class); do not only say “please enter more precise keywords.”
  • Do not pin empty states solely on the user’s wording until you have checked whether the target appears in the first pages under the short query.
  • Verify by taking frequent short queries from logs and judging by hand whether the target is above the fold. Widespread misses mean the index and ranker are punishing short queries, not that users need to be taught to write long sentences.

Related

  • Within the group: G3.02.2 Advanced query syntax is almost never used · G3.02.3 Queries should accept natural language rather than requiring keywords
  • Adjacent: G1.04 Labeling systems · G3.03 Search suggestions · E2.10 Search fields
  • Search terms: query formulation · vocabulary problem · query log analysis

Cards in the same group

Quick Actions

Share

Share this page

ios_share

https://hci.top/en/handbook/G3.02.1