Reliability Ledger
A per-evaluator audit trail of measured trust: agreement with prevalence, calibration, test-retest variance, cross-provider disagreement, recorded as a typed entry with a date and a quarantine flag. The same ρ object enters the math at every gate that consumes evaluator evidence - so an untrusted grader cannot move the system, no matter how loud it is.
Why It Exists
Most pipelines treat evaluator reliability as a quarterly report you read and then ignore. The ledger collapses that two-step into a single typed object the loop already consults: an evaluator below its floor contributes nothing to any update, automatically, with no manual discounting to remember.
Related Terms
Verifier Capital - A verifier is one of the only capital assets that appreciates through operating use.
Gold Standard - A set of human-verified, ground-truth examples used to calibrate and evaluate AI output.