Skip to content

[WIP] Add dspark confidence training - #57

Draft
Mengyuyang wants to merge 3 commits into
verl-project:mainfrom
Mengyuyang:zmj/dspark-confidence-training
Draft

[WIP] Add dspark confidence training#57
Mengyuyang wants to merge 3 commits into
verl-project:mainfrom
Mengyuyang:zmj/dspark-confidence-training

Conversation

@Mengyuyang

Copy link
Copy Markdown
Collaborator

Add dspark confidence training

Add acceptance-probability supervision, confidence checkpoint publishing, and an opt-in vLLM-Ascend dynamic verification example.

Signed-off-by: zhangminjie <eddy_zmj@qq.com>
Route target final hidden states whenever either DSpark distribution loss is enabled. Add a regression test, clarify the confidence target semantics, and place the dynamic NPU example under a naming-compliant path.

Signed-off-by: zhangminjie <eddy_zmj@qq.com>
Pin the confidence-based vLLM-Ascend recipe to the V1 model runner, where PR #13216 implements dynamic verify-budget allocation.

Signed-off-by: zhangminjie <eddy_zmj@qq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant