Rung 11 / How you know it works

Evaluation & Measurement

How you know it works — and whether the measurement can be trusted.

6
Sources
1
Concepts
1
Entities
Paper5Report1AnalysisNews
A brushed steel dial gauge with a copper needle, on paper.

In scope: benchmark design and critique, matched-budget controls, contamination and overfitting to the eval set, agent benchmarks, the eval-to-deployment gap, measurement methodology. Out: the findings themselves, which belong to whichever rung they move.

Three stacked sieves of tightening aperture above the small sample that survives.
BenchmarksMatched budgetContamination
Evaluation & Measurement | Knowledge Base | MenFem