Add repeat-level variability statistics to reward profiling - #2474

Open

mpatel31415 wants to merge 18 commits into

mainfrom

mpatelka/add-variability-statistics

Commits on Aug 11, 2026

feat(eval): initial changes
mpatel31415
committed
f7928f8

Commits on Aug 12, 2026

Commits on Aug 17, 2026

Merge branch 'main' into mpatelka/add-variability-statistics
mpatel31415
committed
4b520aa
feat(eval): final draft of changes
mpatel31415
committed
b6ca9dd
feat(eval): added grouping by agent
mpatel31415
committed
24c5a2f
added new metrics to tests
mpatel31415
committed
3737bf9
feat(eval): added warning if data are missing
mpatel31415
committed
856024b
final version of the code
mpatel31415
committed
82d7b61
feat(eval): saving the data in rsults
mpatel31415
committed
36c2423

Commits on Aug 18, 2026

feat(eval): adding docs
mpatel31415
committed
54c61c0
fix(eval): manual cleaning of the code
mpatel31415
committed
8d592ae
Merge branch 'main' into mpatelka/add-variability-statistics
mpatel31415
authored
15cbf1b
fix(eval): removing constant agent ref
mpatel31415
committed
25a1b0d
Merge remote-tracking branch 'refs/remotes/upstream/mpatelka/add-variability-statistics' into mpatelka/add-variability-statistics
mpatel31415
committed
f8fa29e
fix(eval): change scipy version
mpatel31415
committed
d84dd91

Commits on Aug 19, 2026

Merge branch 'main' into mpatelka/add-variability-statistics
mpatel31415
authored
ac38fb9

Commits on Aug 20, 2026

Merge branch 'main' into mpatelka/add-variability-statistics
mpatel31415
authored
d149deb