[trainer] feat: generic remote backend abstraction for RL Training - #6422

Merged

wuxibin89 merged 38 commits into

verl-project:release/v0.7.1from

Snowflake-AI-Research:arctic_rl_share_v0.7.1

Jul 16, 2026

Commits on May 20, 2026

RemoteBackend abstraction + Arctic adapter for verl

sfc-gh-kganesan
and
cursoragent
committed
d55fe02
Merge pull request #2 from sfc-gh-kganesan/karthik/remote-backend-abstraction-public
sfc-gh-truwase
authored
61ed850

Commits on May 21, 2026

[refactor] Rename `arctic_rl` config namespace to generic `remote_backend.arctic`

sfc-gh-kganesan
and
cursoragent
committed
eec25e8
Address PR #3 review (Tunji): defaults + async + tokenizer

sfc-gh-kganesan
and
cursoragent
committed
b9d2914
Fix `_create_ds_config` closing-brace indent (gemini-bot G4)

sfc-gh-kganesan
and
cursoragent
committed
d1ff467
save_checkpoint: bare `await` (per Tunji)

sfc-gh-kganesan
and
cursoragent
committed
188338b

Commits on May 22, 2026

Merge pull request #3 from sfc-gh-kganesan/karthik/wang-rename
sfc-gh-truwase
authored
17d2aeb

Commits on May 23, 2026

arctic_rl_client: bare `await` on fwd_no_grad/fwd_bwd/step (per Tunji)

sfc-gh-kganesan
and
cursoragent
committed
8aec8a6
Move adapter + rollout into per-backend module paths (zw0610 #2/#3/#4)

sfc-gh-kganesan
and
cursoragent
committed
9e9f6af
Restructure remote_backend abstraction (zw0610 #1/#5/#6/#7)

sfc-gh-kganesan
and
cursoragent
committed
9b82e95
arctic_rl worker: eager-import adapter for Ray child procs

sfc-gh-kganesan
and
cursoragent
committed
e4aaee0

Commits on May 29, 2026

Commits on Jun 9, 2026

ci: address pre-commit failures on verl-project/verl#6422

sfc-gh-kganesan
and
cursoragent
committed
23e6a36
arctic_rl: await self._client.shutdown() in destroy()

sfc-gh-kganesan
and
cursoragent
committed
cbf9cd5
arctic_rl: align adapter with upcoming zorro_train config grouping

sfc-gh-kganesan
and
cursoragent
committed
21ac6e8
arctic_rl: also forward zorro_train_max_rollouts in per-call meta

sfc-gh-kganesan
and
cursoragent
committed
394e6fb
arctic_rl: plumb cuda_ipc weight sync + align generate API

sfc-gh-kganesan
and
cursoragent
committed
a5323c9

Commits on Jun 10, 2026

Merge pull request #5 from Snowflake-AI-Research/karthik/zorro-train-rename
sfc-gh-kganesan
authored
2174486

Commits on Jun 17, 2026

arctic_rl: adapter for arctic_platform.rl on the new RemoteBackend shape
sfc-gh-kganesan
committed
fbab32f
Fix zorro log-prob off-by-one in no_padding_2_padding (#25)

sfc-gh-xyu
authored and
sfc-gh-kganesan
committed
7eb2121
RL correctness: grad clipping, LR schedule horizon, fp32 grads, zorro load-balancer flag

authored and
sfc-gh-kganesan
committed
bc510b1
ds_config format + ds_config passthru

authored and
sfc-gh-kganesan
committed
1f41c88
enable_gradient_checkpointing is configurable now

sfc-gh-sbekman
authored and
sfc-gh-kganesan
committed
0126bb7
add logits_compute_from_fp32_inputs + logits_compute_in_fp32 configs

sfc-gh-sbekman
authored and
sfc-gh-kganesan
committed
e689990
cleanup: trim review-pass slop from adapter comments + collapse defensive config walk

sfc-gh-kganesan
and
cursoragent
committed
8e63086

Commits on Jun 23, 2026

Integrate Zorro Inference (FCA) and Arctic Speculative Decoding into Arctic Platform (#39)

authored and
sfc-gh-truwase
committed
d5ea727
Consolidate weight_sync options (#41)

sfc-gh-truwase
and
cursoragent
committed
3632111
Undo zorro-specific padding (#40)

sfc-gh-truwase
and
cursoragent
committed
41f1061

Commits on Jun 25, 2026

e2e training
sfc-gh-truwase
committed
1e89cb8

Commits on Jun 26, 2026

Commits on Jun 29, 2026

PPO mini batch
sfc-gh-truwase
committed
f7c4647
override ray's max_concurrency
sfc-gh-mhidayetoglu
committed
ac1f642

Commits on Jun 30, 2026

Commits on Jul 9, 2026

[trainer, remote_backend] refactor: make RemoteBackend adapters plugin-only; strip Arctic from verl core

sfc-gh-kganesan
and
cursoragent
committed
b2aef6e

Commits on Jul 15, 2026

Merge pull request #10 from Snowflake-AI-Research/karthik/remote-backend-plugin-hook
sfc-gh-kganesan
authored
5a6491c