Research questions must be answerable with observable evidence
Aliases: operationalizable research question · empirical answerability · falsifiable question
What it is
An empirically answerable research question is one for which possible observations could support, weaken, or distinguish candidate answers. “Can first-time customers complete account opening without assistance?” becomes answerable once first-time, completion, and assistance are defined. “Is the experience humane enough?” remains a value judgment until “humane” is connected to observable constructs. Evidence need not be numeric: concrete accounts, field behavior, documentary traces, and systematically coded themes can all answer questions when the inference from evidence to claim is explicit.
Why it happens
Abstract constructs are not directly observed. Research requires operationalization: define a construct, choose observations that indicate it, and state how results change the conclusion. Every mapping loses information. Trust may be indicated by granting permission, relying on advice, or rating subjective confidence; those measures are not interchangeable. A claim can extend only as far as its operationalization. If no plausible observation could count against the expected answer, the question is seeking confirmation rather than enabling inquiry.
Studying it
Question review can use three tests. An evidence test lists observations that would support, challenge, or leave the question unresolved. A construct test separates the intended concept from its measure and identifies when they could decouple. A rival-explanation test asks whether recruitment, task difficulty, moderator assistance, or system performance could produce the same observation. A protocol can connect question, unit of analysis, sampling boundary, observation, and decision rule in an evidence matrix. Pilot cases test whether the evidence can be captured; they are not confirmatory results.
Where it stops holding
Observable does not mean that every inquiry must quantify an outcome, estimate a causal effect, or reach statistical significance. Descriptive, interpretive, and generative questions can be answered with qualitative material when claims remain at the level that material supports. Ethically inaccessible behavior, rare high-consequence events, and nonexistent future settings may require simulation, proxies, or scenarios; the distance between proxy and phenomenon then limits the conclusion. Operationalization also does not grant external validity across unsampled populations, devices, or periods.
Applying it
- Rewrite the question as: for which people, tasks, and conditions will which observation distinguish which explanations?
- Add three columns to the plan: supporting evidence, challenging evidence, and evidence that remains indeterminate.
- Give every abstract term an operational definition; retain multiple indicators or narrow the claim when several measures are defensible.
- Ask a colleague outside the study to infer how the planned data answer the question. If they can only say the study will “collect feedback,” the question is not yet empirically answerable.