Cross-family: cost-optimized cadence, judge experiment, and PR profiles - #1002

Merged

AbhitejJohn merged 21 commits into

mainfrom

abhitejjohn-cautious-meme

Aug 14, 2026

Commits on Jul 31, 2026

ci(eval): add opt-in cross-family model matrix to the eval pipeline

AbhitejJohn
and
Copilot
committed
ccefe9e

Commits on Aug 3, 2026

Merge origin/main for dotnet-test cross-family evaluation
AbhitejJohn
committed
378a232
test(eval): shard dotnet-test evaluation workload
AbhitejJohn
committed
8b58eab

Commits on Aug 10, 2026

Add cost-optimized cross-family cadence, judge experiment, and full PR mode

AbhitejJohn
and
Copilot
committed
cb20329
Rename opus profile to opus48 for specificity

AbhitejJohn
and
Copilot
committed
68d82f6
Remove legacy single profile; default is now the floor

AbhitejJohn
and
Copilot
committed
17ac1a4
Capture symmetric judge stats for apples-to-apples comparison

AbhitejJohn
and
Copilot
committed
6da3fad
Add /evaluate --opus48 PR-comment flag

AbhitejJohn
and
Copilot
committed
8532795
MMR fixes: anchor /evaluate flags; qualify judge-comparison key by plugin

AbhitejJohn
and
Copilot
committed
ee1cffa
dashboard: segment quality trends and summary by executor model

AbhitejJohn
and
Copilot
committed
9154e45
dashboard: let per-model summary table span the full card row

AbhitejJohn
and
Copilot
committed
f32d390

Commits on Aug 11, 2026

dashboard: add per-model filter to focus the view on selected models

AbhitejJohn
and
Copilot
committed
854f5c7
Fix per-plugin colour map leaking across dashboard tabs

AbhitejJohn
and
Copilot
committed
5e71a7e
Restore dotnet-msbuild eval sharding

JanKrivanek
and
Copilot
committed
e71cb44
Merge origin/main into abhitejjohn-cautious-meme

AbhitejJohn
and
Copilot
committed
dc8c397
Swap default executor to gpt-5.6-luna; judges to gpt-5.6-sol

AbhitejJohn
and
Copilot
committed
0a34b56
Run secondary-judge adapter from trusted staged copy

AbhitejJohn
and
Copilot
committed
1105254