[rllib] Add SAC testing to premerge#59581

Draft

pseudo-rnd-thoughts wants to merge 48 commits intoray-project:masterfrom

pseudo-rnd-thoughts:sac-premerge-nightly

Commits on Nov 21, 2025

[rllib] Merge tuned-examples into examples
Mark Towers
committed
Update BUILD.bazel for tuned-examples new location
Mark Towers
committed
Gemini review
Mark Towers
committed
Merge branch 'master' into merge-tuned-examples
Mark Towers
committed

Commits on Nov 24, 2025

update offline data path
Mark Towers
committed
update tuned_example file paths
Mark Towers
committed
Fix file paths
Mark Towers
committed

Commits on Nov 26, 2025

Merge branch 'master' into merge-tuned-examples
Mark Towers
committed
Update rllib release test directory and release test paths
Mark Towers
committed
[rllib] Update APPO premerge
Mark Towers
committed

Commits on Nov 27, 2025

Merge branch 'master' into appo-premerge
Mark Towers
committed
Clean appo folder
Mark Towers
committed
Add stateles cartpole
Mark Towers
committed

Commits on Dec 1, 2025

Merge branch 'master' into appo-premerge
Mark Towers
committed
pre-commit
Mark Towers
committed

Commits on Dec 2, 2025

Improve documentation
Mark Towers
committed

Commits on Dec 3, 2025

Fix training scripts
Mark Towers
committed

Commits on Dec 10, 2025

Merge branch 'master' into appo-premerge
Mark Towers
committed
Change to TicTacToe from Connect4
Mark Towers
committed
Updated to BUILD.bazel to tictactoe file
Mark Towers
committed

Commits on Dec 11, 2025

kamil code-review
Mark Towers
committed
Merge branch 'master' into appo-premerge
pseudo-rnd-thoughts
authored

Commits on Dec 12, 2025

code-review
Mark Towers
committed

Commits on Dec 15, 2025

update tictactoe and stop rewards
Mark Towers
committed

Commits on Dec 16, 2025

Merge branch 'master' into appo-premerge
kamil-kaczmarek
authored
Add nightly tests
Mark Towers
committed
Add default_iters to atari
Mark Towers
committed
Update sac examples
Mark Towers
committed
Update tic tac toe implementation
Mark Towers
committed

Commits on Dec 17, 2025

Rewrite TicTacToe and add stop rewards / iters for premerge
Mark Towers
committed
Merge branch 'master' into appo-premerge
Mark Towers
committed
Fix release tests cluster_compute
Mark Towers
committed

Commits on Dec 18, 2025

Added docstrings
Mark Towers
committed
code-review
Mark Towers
committed
remove type: gpu from non gpu nightly
Mark Towers
committed

Commits on Dec 19, 2025

code review
Mark Towers
committed
Merge branch 'appo-premerge' into sac-premerge-nightly
Mark Towers
committed
Update the parameters
Mark Towers
committed
Add note about GPU learners
Mark Towers
committed
Fix run name
Mark Towers
committed
pre-commit + more docstring details
Mark Towers
committed

Commits on Dec 29, 2025

Merge branch 'master' into appo-premerge
Mark Towers
committed
Reduce the number of env-runners from 5 to 4
Mark Towers
committed

Commits on Dec 31, 2025

Update documentation
Mark Towers
committed
Merge branch 'master' into sac-premerge-nightly
Mark Towers
committed
Merge branch 'appo-premerge' into sac-premerge-nightly
Mark Towers
committed
Update documentation, remove appo changes
Mark Towers
committed

Commits on Jan 5, 2026

Fix the tictactoe implementation
Mark Towers
committed