Skip to content

Arm backend: Add DeepSeek-R1-Distill-Qwen FP8 layer tests#21012

Merged
bdemirb merged 1 commit into
pytorch:mainfrom
bdemirb:baris_mletorch-2337_fp8_layer_test_DeepSeek_R1_Distill_Qwen_1.5B
Jul 20, 2026
Merged

Arm backend: Add DeepSeek-R1-Distill-Qwen FP8 layer tests#21012
bdemirb merged 1 commit into
pytorch:mainfrom
bdemirb:baris_mletorch-2337_fp8_layer_test_DeepSeek_R1_Distill_Qwen_1.5B

Conversation

@bdemirb

@bdemirb bdemirb commented Jul 17, 2026

Copy link
Copy Markdown
Collaborator

@bdemirb
bdemirb requested a review from digantdesai as a code owner July 17, 2026 14:09
@pytorch-bot

pytorch-bot Bot commented Jul 17, 2026

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/21012

Note: Links to docs will display an error until the docs builds have been completed.

⏳ 1 Pending, 1 Unrelated Failure

As of commit 12313d1 with merge base c995192 (image):

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jul 17, 2026
@github-actions github-actions Bot added ciflow/trunk module: arm Issues related to arm backend labels Jul 17, 2026
@bdemirb

bdemirb commented Jul 17, 2026

Copy link
Copy Markdown
Collaborator Author

@pytorchbot label "partner: arm"

@pytorch-bot pytorch-bot Bot added the partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm label Jul 17, 2026
@bdemirb

bdemirb commented Jul 17, 2026

Copy link
Copy Markdown
Collaborator Author

@pytorchbot label "release notes: arm"

@pytorch-bot pytorch-bot Bot added the release notes: arm Changes to the ARM backend delegate label Jul 17, 2026
@bdemirb
bdemirb force-pushed the baris_mletorch-2337_fp8_layer_test_DeepSeek_R1_Distill_Qwen_1.5B branch from 8bfcedd to c8ea520 Compare July 20, 2026 11:17
This patch adds follow-up MXFP8 layer-test coverage for
DeepSeek-R1-Distill-Qwen-1.5B on the Arm backend.

The coverage follows the Qwen3-VL FP8 layer-test structure and
focuses on the Qwen2 linear-heavy layers used by the distilled
checkpoint: attention, MLP, and decoder layer.

Both FP32-input and BF16-input paths use MXFPOpConfig with
float8_e4m3fn weights and lower through the TOSA 1.1 FP mxfp
extension. The BF16 path also enables the bf16 extension.

Signed-off-by: Baris Demir <baris.demir@arm.com>

Change-Id: I2337d551a1b3c6c2d23b09d697c7713de6d9a5c0
@bdemirb
bdemirb force-pushed the baris_mletorch-2337_fp8_layer_test_DeepSeek_R1_Distill_Qwen_1.5B branch from c8ea520 to 12313d1 Compare July 20, 2026 14:51
@bdemirb
bdemirb merged commit e8c47d7 into pytorch:main Jul 20, 2026
490 of 494 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/trunk CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. module: arm Issues related to arm backend partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm release notes: arm Changes to the ARM backend delegate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants