Skip to content
Merged
Show file tree
Hide file tree
Changes from 4 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions backends/arm/MODELS.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@
- Conformer
- Deep AutoEncoder
- Deit Tiny
- DeepSeek-R1-Distill-Qwen-1.5B
- DeepLab v3 (DL3)
- DS CNN
- Inception v3 (IC3)
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
# Copyright 2026 Arm Limited and/or its affiliates.
#
# This source code is licensed under the BSD-style license found in the
# LICENSE file in the root directory of this source tree.

from transformers.models.qwen2.configuration_qwen2 import Qwen2Config


def get_deepseek_r1_distill_qwen_1_5b_checkpoint_config() -> Qwen2Config:
return Qwen2Config(

Check failure on line 10 in backends/arm/test/models/DeepSeek_R1_Distill_Qwen/deepseek_r1_distill_qwen_test_config.py

View workflow job for this annotation

GitHub Actions / lintrunner-mypy

MYPY call-arg

Unexpected keyword argument "use_mrope" for "Qwen2Config" To disable, use ` # type: ignore[call-arg]`

Check failure on line 10 in backends/arm/test/models/DeepSeek_R1_Distill_Qwen/deepseek_r1_distill_qwen_test_config.py

View workflow job for this annotation

GitHub Actions / lintrunner-mypy

MYPY call-arg

Unexpected keyword argument "torch_dtype" for "Qwen2Config" To disable, use ` # type: ignore[call-arg]`
architectures=["Qwen2ForCausalLM"],
attention_dropout=0.0,
bos_token_id=151643,
eos_token_id=151643,
hidden_act="silu",
hidden_size=1536,
initializer_range=0.02,
intermediate_size=8960,
max_position_embeddings=131072,
max_window_layers=21,
num_attention_heads=12,
num_hidden_layers=28,
num_key_value_heads=2,
rms_norm_eps=1e-6, # type: ignore[arg-type]
rope_parameters={
"rope_type": "default",
"rope_theta": 10000.0,
},
sliding_window=4096,
tie_word_embeddings=False,
torch_dtype="bfloat16",
transformers_version="4.44.0",
use_cache=True,
use_mrope=False,
use_sliding_window=False,
vocab_size=151936,
)
Loading
Loading