feat: Arctic RL training backend integration - #1

Open

sfc-gh-kganesan wants to merge 41 commits into

mainfrom

arctic-rl-public

Commits on Apr 25, 2026

feat: Arctic RL (DeepSpeed) training backend integration
sfc-gh-kganesan
committed
75dae67

Commits on Apr 28, 2026

feat: single entrypoint — route to Arctic RL backend when trainer.arctic_rl is set

sfc-gh-kganesan
authored and
sfc-gh-truwase
committed
11e9e09
Update README for Arctic RL integration details
sfc-gh-jrasley
authored
29de7a9

Commits on May 11, 2026

Commits on May 21, 2026

Commits on May 25, 2026

Commits on Jun 1, 2026

Merge pull request #3 from Snowflake-AI-Research/proposal/backend-registry
sfc-gh-kganesan
authored
170750f

Commits on Jun 9, 2026

arctic_rl: generic backend discoverability + Ray-worker import path

sfc-gh-kganesan
and
claude
committed
159f7b7

Commits on Jun 11, 2026

Merge pull request #4 from Snowflake-AI-Research/arctic-rl-backend-discoverability
sfc-gh-kganesan
authored
9b843a0

Commits on Jun 17, 2026

Repoint integration to arctic_platform.rl (minimal API adaptation)

sfc-gh-kganesan
and
cursoragent
committed
1df089b
Add SkyRL+BIRD recipe (verl PR #6 parity surface)

sfc-gh-kganesan
and
cursoragent
committed
138afaa
Attach runtime_env per-task so arctic_rl is importable in Ray workers

sfc-gh-kganesan
and
cursoragent
committed
17271ef
_to_batch: ship verl-shape (prompts, responses, response_mask)

sfc-gh-kganesan
and
cursoragent
committed
4599231
arctic-rl: bridge full verl wire protocol from SkyRL adapter
karthik
committed
9f1fbed
arctic-rl: fast-iter smoke recipe + flatten per-rank grad_norm
karthik
committed
a31617f

Commits on Jun 19, 2026

arctic_rl: parallelize reward scoring with a ProcessPoolExecutor

sfc-gh-kganesan
and
cursoragent
committed
46f7a55
arctic_rl: expose verl-aligned memory/perf knobs in config and recipe

sfc-gh-kganesan
and
cursoragent
committed
b6c8c7c
arctic_rl: trainer dispatch and meta fixes for verl PR #6 parity

sfc-gh-kganesan
and
cursoragent
committed
484ffbf
arctic_rl: pad responses to ZoRRO patcher fixed response_len

sfc-gh-kganesan
and
cursoragent
committed
e771829

Commits on Jun 24, 2026

Commits on Jun 25, 2026

SkyRL core: trainer.override_entrypoint dispatch (addresses Sumanth S5+S6)

sfc-gh-truwase
and
cursoragent
committed
2587f0e
arctic_rl: env-overridable SKYRL_DIR + PYBIN in 32B launchers

sfc-gh-truwase
and
cursoragent
committed
bb43337
arctic_rl: single-flag UX — usable with any SkyRL recipe via one CLI override

sfc-gh-truwase
and
cursoragent
committed
107de2e
arctic_rl: strip internal env defaults from launchers

sfc-gh-truwase
and
cursoragent
committed
ee13bb2
arctic_rl README: drop fsdp from install (arctic-rl extra is self-sufficient)

sfc-gh-truwase
and
cursoragent
committed
59eacde
arctic_rl: make trainer.logger env-overridable (LOGGER) in 32B launcher

sfc-gh-truwase
and
cursoragent
committed
a9a8f7f
arctic_rl README: full from-empty-directory setup walkthrough

sfc-gh-truwase
and
cursoragent
committed
876698c
arctic_rl: auto-prep data + auto-download models in launchers

sfc-gh-truwase
and
cursoragent
committed
849de7e
arctic_rl: add liger-kernel to the extra (required for use_liger=true)

sfc-gh-truwase
and
cursoragent
committed
f43ac83
arctic_rl: vendor bird_reward so BIRD env doesn't need a private arctic-platform branch

authored and
sfc-gh-truwase
committed
356cb30
arctic_rl: vendor preprocess_bird so BIRD recipe is fully self-contained

sfc-gh-kganesan
and
cursoragent
committed
4af824e
arctic_rl: route arctic_inference_config through OmegaConf.to_container

sfc-gh-kganesan
and
cursoragent
committed
fea83f0
integrations/arctic_rl: pin optimization_level=1 + add 8B launcher

sfc-gh-kganesan
and
cursoragent
committed
50e054b

Commits on Jun 26, 2026

Merge pull request #5 from Snowflake-AI-Research/karthik/skyrl-arctic-rl-refactor-deltas
sfc-gh-kganesan
authored
7636101