[3/N][model, rollout, reward] feat: add Qwen3-TTS GRPO support - #428

Merged

zhtmike merged 34 commits into

verl-project:mainfrom

dongbo910220:qwen3-tts-generic-grpo-pr

Sep 9, 2026

Commits on Sep 1, 2026

[model, rollout] feat: add Qwen3-TTS talker pipeline

dongbo910220
and
Michael-Zzq
committed
be0f32f
[reward, cfg] feat: add Qwen3-TTS GRPO audio reward recipe

dongbo910220
and
Michael-Zzq
committed
78ea2e2
[rollout] fix: align Qwen3-TTS prompt embedding dtype

dongbo910220
and
Michael-Zzq
committed
eb66ec7
[rollout] fix: register Qwen3-TTS model in vLLM workers

dongbo910220
and
Michael-Zzq
committed
498d7a8
[rollout] fix: initialize Qwen3-TTS rollout workers

dongbo910220
and
Michael-Zzq
committed
7205e4c
[model, worker] fix: align Qwen3-TTS rollout probabilities

dongbo910220
and
Michael-Zzq
committed
183a19a
[doc, tests] test: document generic omni rollout hooks

dongbo910220
and
Michael-Zzq
committed
24d3e58
[rollout, tests] refactor: use native bucketed weight loading

dongbo910220
and
Michael-Zzq
committed
932e80d
[trainer] refactor: restore BF16 Qwen3-TTS GRPO path

dongbo910220
and
Michael-Zzq
committed
0598b1a
[rollout, model] refactor: generalize omni single-turn agent
dongbo910220
committed
bd15236
[rollout, tests] refactor: reuse standard single-turn flow
dongbo910220
committed
c7277cc
[model, tests] fix: restore Qwen3-TTS config default
dongbo910220
committed
cdbe1ed
[doc] chore: cite TTS GRPO references
dongbo910220
committed
a772a8c
[model, rollout, tests, doc] fix: address Qwen3-TTS review feedback
dongbo910220
committed
1d95ccf
[model, tests] fix: remove unneeded reference offload exception
dongbo910220
committed
d03a317
[rollout, tests, doc] refactor: align Qwen3-TTS with AR strategy
dongbo910220
committed
887a88e
[model, rollout, tests, doc] refactor: address follow-up review
dongbo910220
committed
115d688
[model, rollout, tests] refactor: use generic Talker replay interface
dongbo910220
committed
94dd2d1
[model, rollout, tests] refactor: enforce fail-closed Talker contracts
dongbo910220
committed
37af036
[rollout, tests] fix: preserve AR strategy compatibility
dongbo910220
committed
c5fafa7
[model, rollout, tests] fix: restore upstream-owned behavior
dongbo910220
committed
9d2fe6f
[rollout, tests] fix: preserve single-output AR pipelines
dongbo910220
committed
2ea5103

Commits on Sep 3, 2026

Commits on Sep 8, 2026

[model, rollout, reward] chore: integrate merged shared APIs
dongbo910220
committed
e09f61b
[model, rollout, reward] chore: sync Qwen3-TTS with latest main

dongbo910220
and
GitHub Copilot
committed
25ac42d
[rollout, ci, tests] fix: preserve Qwen3-TTS Code2Wav placeholders
dongbo910220
committed
7968c76

Commits on Sep 9, 2026