Skip to content

feat(vllm): enable 0.24.0 app images for cambricon/enflame/iluvatar-4.4.0 #678

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
tengqm merged 1 commit into from
Sep 2, 2026
Merged

feat(vllm): enable 0.24.0 app images for cambricon/enflame/iluvatar-4.4.0 #678

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 8 additions & 2 deletions configs.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -276,6 +276,7 @@ vendors:
deps_app:
megatron_training: []
vllm0.20.2: []
vllm0.24.0: []
sdk:
- cnmon 6.2.15 # cnmon-6.2.15-x86_64.zip
- cntoolkit 4.4.3 # cntoolkit_4.4.3-1.ubuntu22.04_amd64.deb
Expand Down Expand Up @@ -305,6 +306,7 @@ vendors:
deps_app:
megatron_training: []
vllm0.20.2: []
vllm0.24.0: []
sdk:
- cnmon 6.5.48 # cnmon-6.5.48-x86_64.zip
- cntoolkit 4.7.2 # cntoolkit_4.7.2-1.ubuntu24.04_amd64.deb
Expand Down Expand Up @@ -342,6 +344,7 @@ vendors:
# megatron_training added: verified F+T ([build-infra #639](https://github.com/flagos-ai/build-infra/pull/639)).
megatron_training: []
vllm0.20.2: []
vllm0.24.0: []
sdk:
- Enflame driver 1.9.10 # enflame-x86_64-gcc-1.9.10-20260520104313.run
- TOPS Runtime 1.9.10 # topsruntime_1.9.10-1_amd64.deb
Expand Down Expand Up @@ -385,6 +388,7 @@ vendors:
deps_app:
megatron_training: []
vllm0.20.2: []
vllm0.24.0: []
sdk:
- Enflame driver 1.10.6 # enflame-x86_64-gcc-1.10.6-20260720190108.run
- TOPS Runtime 1.10.6 # topsruntime_1.10.6-1_amd64.deb
Expand Down Expand Up @@ -448,9 +452,11 @@ vendors:
- torchvision==0.22.1+corex.4.4.0
- numpy==1.26.4
deps_app:
# megatron_training only: verified F+T ([build-infra #639](https://github.com/flagos-ai/build-infra/pull/639)). vllm gates stay off —
# iluvatar 4.4.0 is ⬜/❌ in the vllm 0.20.2/0.24.0 matrices.
# megatron_training only: verified F+T ([build-infra #639](https://github.com/flagos-ai/build-infra/pull/639)).
# vllm0.24.0 added for the 4.4.0 garbage-output bypass attempt (2026-09-02);
# vllm0.20.2 stays off — 4.4.0 is ❌ in that matrix.
megatron_training: []
vllm0.24.0: []
sdk:
- Corex Runtime 4.4.0 # corex-installer-linux64-4.4.0_x86_64_10.2.run
- CUDA Header files 260604 # cuda-header-260604.zip
Expand Down
14 changes: 9 additions & 5 deletions packaging/vllm/docs/vllm-verification-matrix.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -59,11 +59,15 @@ PR 表"状态"列在渲染时经 `gh` 实时查询 PR 合并状态（已合并 /
| 昇腾 | CANN 9.0.0 | vllm0.20.2 | https://github.com/flagos-ai/vllm-plugin-FL/pull/402 | OPEN |
| 昇腾 | CANN 9.0.0 | vllm0.24.0 | https://github.com/flagos-ai/vllm-plugin-FL/pull/387 | OPEN |
| 寒武纪 | NEUWARE 4.4.3 | vllm0.20.2 | https://github.com/flagos-ai/vllm-plugin-FL/pull/411 | OPEN |
| 寒武纪 | NEUWARE 4.4.3 | vllm0.24.0 | https://github.com/flagos-ai/vllm-plugin-FL/pull/431 | OPEN |
| 寒武纪 | NEUWARE 4.7.2 | vllm0.20.2 | https://github.com/flagos-ai/vllm-plugin-FL/pull/411 | OPEN |
| 寒武纪 | NEUWARE 4.7.2 | vllm0.20.2 | https://github.com/flagos-ai/FlagGems/pull/5745 | 已合并 |
| 寒武纪 | NEUWARE 4.7.2 | vllm0.20.2 | https://github.com/flagos-ai/FlagGems/pull/5510 | 已合并 |
| 寒武纪 | NEUWARE 4.7.2 | vllm0.24.0 | https://github.com/flagos-ai/vllm-plugin-FL/pull/431 | OPEN |
| 燧原 | TOPS 1.9.10 | vllm0.20.2 | https://github.com/flagos-ai/FlagGems/pull/5345 | 已合并 |
| 燧原 | TOPS 1.9.10 | vllm0.24.0 | https://github.com/flagos-ai/vllm-plugin-FL/pull/432 | OPEN |
| 燧原 | TOPS 1.10.6 | vllm0.20.2 | https://github.com/flagos-ai/FlagGems/pull/5345 | 已合并 |
| 燧原 | TOPS 1.10.6 | vllm0.24.0 | https://github.com/flagos-ai/vllm-plugin-FL/pull/432 | OPEN |
| 海光 | DTK 26.04 | vllm0.24.0 | https://github.com/flagos-ai/FlagTree/pull/1020 | 已合并 |
| 昆仑芯 | XRE 5.37.1 | vllm0.20.2 | https://github.com/flagos-ai/vllm-plugin-FL/pull/268 | 已合并 |
| 昆仑芯 | XRE 5.37.1 | vllm0.20.2 | https://github.com/flagos-ai/vllm-plugin-FL/pull/400 | OPEN |
Expand Down Expand Up @@ -148,12 +152,12 @@ PR 表"状态"列在渲染时经 `gh` 实时查询 PR 合并状态（已合并 /
| CUDA 13.3 | ✅ | ✅ | ✅ | — |
| CANN 8.5.0 | ✅ | ✅ | ✅ | — |
| CANN 9.0.0 | ✅ | ✅ | ✅ | — |
| NEUWARE 4.4.3 | ⬜ | ⬜ | ⬜ | — |
| NEUWARE 4.7.2 | ⬜ | ⬜ | ⬜ | — |
| TOPS 1.9.10 | ⬜ | ⬜ | ⬜ | — |
| TOPS 1.10.6 | ⬜ | ⬜ | ⬜ | — |
| NEUWARE 4.4.3 | ✅ | ⬜ | ⬜ | — |
| NEUWARE 4.7.2 | ✅ | ⬜ | ⬜ | — |
| TOPS 1.9.10 | ✅ | ⬜ | ⬜ | — |
| TOPS 1.10.6 | ✅ | ⬜ | ⬜ | — |
| DTK 26.04 | ✅ | ✅ | ⬜ | app 镜像暂不做（2026-08-20 决策）：F 路径等待 FlagTree 发布修复版本（flagtree hygon wheel 重建） |
| COREX 4.4.0 | ⬜ | ⬜ | ⬜ | — |
| COREX 4.4.0 | ✅ | ⬜ | ⬜ | — |
| COREX 4.5.0 | ✅ | ✅ | ✅ | — |
| XRE 5.37.1 | ✅ | ✅ | ✅ | — |
| MACA 3.7.2.1 | ✅ | ✅ | ✅ | — |
Expand Down
18 changes: 13 additions & 5 deletions packaging/vllm/status_matrix.vllm0.24.0.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -70,25 +70,33 @@ backends:
prs:
- https://github.com/flagos-ai/vllm-plugin-FL/pull/387
cambricon-neuware4.4.3:
deps_app: false
deps_app: true
launch_docs: false
prs:
- https://github.com/flagos-ai/vllm-plugin-FL/pull/431
cambricon-neuware4.7.2:
deps_app: false
deps_app: true
launch_docs: false
prs:
- https://github.com/flagos-ai/vllm-plugin-FL/pull/431
enflame-tops1.9.10:
deps_app: false
deps_app: true
launch_docs: false
prs:
- https://github.com/flagos-ai/vllm-plugin-FL/pull/432
enflame-tops1.10.6:
deps_app: false
deps_app: true
launch_docs: false
prs:
- https://github.com/flagos-ai/vllm-plugin-FL/pull/432
hygon-dtk26.04:
deps_app: true
launch_docs: true
note: "app 镜像暂不做（2026-08-20 决策）：F 路径等待 FlagTree 发布修复版本（flagtree hygon wheel 重建）"
prs:
- https://github.com/flagos-ai/FlagTree/pull/1020
iluvatar-corex4.4.0:
deps_app: false
deps_app: true
launch_docs: false
iluvatar-corex4.5.0:
deps_app: true
Expand Down
Loading