Skip to content

chore: bump ms-swift from 3.5.3 to 3.9.2 - #56

Open
dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/pip/ms-swift-3.9.2
Open

chore: bump ms-swift from 3.5.3 to 3.9.2#56
dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/pip/ms-swift-3.9.2

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Oct 27, 2025

Copy link
Copy Markdown

Bumps ms-swift from 3.5.3 to 3.9.2.

Release notes

Sourced from ms-swift's releases.

Patch release v3.9.2

Full Changelog: modelscope/ms-swift@v3.9.1...v3.9.2

Patch release v3.9.1

Full Changelog: modelscope/ms-swift@v3.9.0...v3.9.1

v3.9.0

中文版

新特性

  1. Megatron-SWIFT a. 支持更多模型架构:Qwen3-VL, Qwen3-Omni, Qwen3-Next, Kimi-VL, InternVL3.5-HF等。完整的模型支持情况,参考支持的模型文档:https://swift.readthedocs.io/en/latest/Instruction/Supported-models-and-datasets.html b. 支持KTO训练,包括全参数/LoRA/MoE/多模态/Packing等训练技术等支持。感谢招商银行技术团队@​kevssim 的贡献。训练脚本参考:https://github.com/modelscope/ms-swift/tree/main/examples/megatron/rlhf/kto c. 支持RM训练,包括全参数/LoRA/MoE/多模态/Packing等训练技术等支持。训练脚本参考:https://github.com/modelscope/ms-swift/tree/main/examples/megatron/rlhf/rm d. 支持序列分类模型架构,包括三种任务:regression、single_label_classification、multi_label_classification。训练脚本参考:https://github.com/modelscope/ms-swift/tree/main/examples/megatron/seq_cls e. 支持VPP并行技术,减少PP并行的计算空泡,提高GPU利用率,但会略微提高通信量。支持异构PP并行 pipeline_model_parallel_layout,自定义流水线并行(PP/VPP)布局。 f. DPO等RLHF技术中的ref_model不初始化 main_grad 降低显存占用。
  2. 训练 a. 序列并行优化,ulysses 和 ring-attention 支持混合使用,实现更长的序列处理能力。支持纯文本和多模态模型的SFT/DPO/GRPO训练。训练脚本参考:https://github.com/modelscope/ms-swift/blob/main/examples/train/sequence_parallel/sequence_parallel.sh b. 纯文本及多模态模型Embedding/Reranker/序列分类任务训练支持使用 padding_free 以节约显存资源并加速训练。 c. Embedding和Reranker训练数据集格式重构,具体参考文档:https://swift.readthedocs.io/en/latest/BestPractices/Embedding.html, https://swift.readthedocs.io/en/latest/BestPractices/Reranker.html d. Agent template支持更多模型:deepseek_v3_1, qwen3_coder。(感谢@​gakkiri ,@​ray075hl 的贡献) e. load_from_cache_file 默认值从True改成False,避免因缓存原因导致的未知问题。
  3. RLHF a. GRPO支持CHORD算法,在GRPO训练中混合SFT训练,参考文档:https://swift.readthedocs.io/en/latest/Instruction/GRPO/AdvancedResearch/CHORD.html b. KTO支持padding free和packing以节约显存资源并加速训练。 c. GRPO训练 padding_free重构,更好支持多模态模型。 d. GRPO vLLM 支持PYTORCH_CUDA_ALLOC_CONF="expandable_segments:True"环境变量,减小显存碎片。
  4. 推理 a. 支持Reranker任务的推理/部署 (pt/vllm),以及序列分类任务的推理部署(pt/vllm)。脚本参考:https://github.com/modelscope/ms-swift/tree/main/examples/deploy/reranker, https://github.com/modelscope/ms-swift/tree/main/examples/deploy/seq_cls

新模型

  1. 纯文本模型 a. Qwen/Qwen3-Next-80B-A3B-Instruct系列,训练脚本参考:https://github.com/modelscope/ms-swift/tree/main/examples/models/qwen3_next b. ZhipuAI/GLM-4.6 c. inclusionAI/Ling-mini-2.0; inclusionAI/Ring-mini-2.0系列 d. iic/Tongyi-DeepResearch-30B-A3B e. ByteDance-Seed/Seed-OSS-36B-Instruct系列(感谢@​hpsun1109 的贡献) f. deepseek-ai/DeepSeek-V3.1-Terminus g. PaddlePaddle/ERNIE-4.5-21B-A3B-Thinking h. google/embeddinggemma-300m(embedding模型)
  2. 多模态模型 a. Qwen/Qwen3-VL-30B-A3B-Instruct系列,训练脚本参考:https://github.com/modelscope/ms-swift/tree/main/examples/models/qwen3_vl b. Qwen/Qwen3-Omni-30B-A3B-Instruct系列,训练脚本参考:https://github.com/modelscope/ms-swift/tree/main/examples/models/qwen3_omni c. Kwai-Keye/Keye-VL-1_5-8B(感谢@​hellopahe 的贡献) d. OpenGVLab/InternVL3_5-1B-HF系列 e. BytedanceDouyinContent/SAIL-VL2-2B系列 f. stepfun-ai/Step-Audio-2-mini(感谢@​CJack812 的贡献)

... (truncated)

Commits

Dependabot compatibility score

You can trigger a rebase of this PR by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Note
Automatic rebases have been disabled on this pull request as it has been open for over 30 days.

@dependabot dependabot Bot added dependencies Pull requests that update a dependency file python Pull requests that update python code labels Oct 27, 2025
Bumps [ms-swift](https://github.com/modelscope/swift) from 3.5.3 to 3.9.2.
- [Release notes](https://github.com/modelscope/swift/releases)
- [Commits](modelscope/ms-swift@v3.5.3...v3.9.2)

---
updated-dependencies:
- dependency-name: ms-swift
  dependency-version: 3.9.2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot Bot added dependencies Pull requests that update a dependency file python Pull requests that update python code labels Oct 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file python Pull requests that update python code size/XS

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants