v1.8.0

1.8.0 (2026-07-11)

Features

• eval: add LLM-judge alert-precision module over unlabeled radios (b727baa)
• eval: add metrics-registry + calibration harness (f1-eval) (c08780d), closes #206
• eval: add NLP per-stage eval harness (f1-eval nlp) (dbf76b1), closes #304
• eval: add threshold-provenance + leakage hygiene report (f1-eval hygiene) (3788167), closes #207
• eval: compute radio alert precision from gold intent labels (16bd305), closes #304
• eval: LLM-judge alert precision over unlabeled radios (#304 follow-up) (1651c3b)
• eval: ML metrics-registry + calibration harness (f1-eval, #206) (380f1d7)
• eval: NLP per-stage eval harness (f1-eval nlp, #304) (1c8ff7c)
• eval: radio alert precision from gold labels (closes #304) (da1db0c)
• eval: recompute SC + undercut calibration + AUC-PR (part of #364) (5c97461)
• eval: recompute SC + undercut calibration and AUC-PR from in-memory holdouts (7365b50), closes #364
• eval: regenerate pit holdout from raw laps (closes #364) (d66ddae)
• eval: regenerate pit holdout from raw laps + recompute coverage and MAE (ccc213d), closes #364
• eval: reproduce intent setfit-free + #303 NLP hygiene verdicts (6bc5413)
• eval: reproduce intent setfit-free and record #303 NLP hygiene verdicts (275c487)
• eval: reproduce NER entity-F1 + RCM coverage (#304) (bc0350d)
• eval: reproduce NER entity-F1 and RCM coverage in the NLP harness (1efb133), closes #304
• eval: threshold-provenance + leakage hygiene report (#207) (5f1f29d)
• eval: wire f1-eval alert-llm + report the unlabeled-corpus finding (1e9fed1), closes #304

Bug Fixes

• eval: align undercut provenance wording with in-train relabeling (Fable re-verify) (54e5d42)
• eval: correct SC operating threshold + window on honest splits (#363) (1275101)
• eval: correct SC threshold + window on honest splits (closes #363) (e1ee603)
• eval: relabel SC/overtake threshold corrections as in-train (Fable gate) (c38c94e)

Documentation

• eval: regenerate hygiene report with in-train relabeling + correct provenance stamp (c1af9c1)
• roadmap: reconcile published metrics to thesis/IEEE finals (2758ec5)
• roadmap: reconcile published metrics to thesis/IEEE finals (#213) (50b7ecf)