Ranking criteria must be public and contestable
Aliases: scoring transparency · public weights · arguable priorities
What it is
Contestable ranking criteria means the dimensions, weights, evidence sources, and scoring rules that put one opportunity ahead of another sit where the team can see and rebut them, rather than in a facilitator’s spoken “we all feel.” Contestable does not require identical scores. It requires disagreement to aim at rules and evidence rather than at whoever talks loudest. A ranking whose grounds stay hidden cannot be corrected; it can only be overwritten by the next round of impressions.
Why it happens
A priority is a claim: under a stated goal, some consequences deserve attention before others. For the claim to be challengeable, listeners must know what it rests on. Unwritten weights smuggle role, recency, and departmental interest into the total; written weights at least make those factors nameable. The point of argument is to expose holes in the rule—for example that “impact” is quietly using revenue as a stand-in for people affected—not to take a vote and close the file.
Studying it
Treat the ranking protocol as an object of analysis. Record which dimensions were used, whether weights were locked in advance, which observations each score cites, and who may change a score. Compare a rule-visible ranking with the oral re-ranking after the meeting: which items move, and whether the reasons introduce undeclared dimensions. Audit disputed items: is the fight about evidence (did this happen) or about the rule (should this count for more). Rule disputes should rewrite the protocol, not just that one score.
Where it stops holding
Public does not mean sending re-identifiable raw material company-wide; evidence can be de-identified excerpts or observation IDs. Scores need not run to decimal places; coarse grades remain contestable if the rule is clear. Emergency shutdowns and live incidents skip a full score sheet, but the grounds used at the time should still be written afterward so the exception does not become a new hidden weight. Reading “contestable” as endless appeal will stall decisions; the triggers for a re-open need to be set in advance.
Applying it
- Put column meanings, grade definitions, and allowed evidence types in the table header; confirm the header before scoring.
- When a rank changes, write whether the change is to evidence or to the rule; if the rule changes, update other items of the same kind.
- Let objectors name an undeclared dimension at work, then either adopt it formally or exclude it explicitly.
- Archive the final grounds together with rejected alternative rules, and start the next ranking from that file rather than from a blank gut feel.