L1.11
Reproducibility of Non-deterministic Output
Cards in this group · 5
- L1.11.1Different outputs from the same input make defects hard to reproduce; a user-reported problem may not replay
- L1.11.2Pinning a random seed only reproduces inside one version; it dies when the model or the prompt is updated
- L1.11.3Without reproduction people cannot form a stable mental model; the learning curve flattens
- L1.11.4After-the-fact trace needs input, system version, and output kept together
- L1.11.5A single comparison cannot rank two options; the conclusion must rest on many draws