Code

Add support for Qwen2 models#746

Code

Merged

dacorvo merged 11 commits intomainhuggingface/optimum-neuron:mainfrom qwen2huggingface/optimum-neuron:qwen2Copy head branch name to clipboardDec 5, 2024

+706-60

Commits

Commits on Dec 2, 2024

• feat(export): allow to set fuse_qkv=False for decoders

  dacorvo

  committed
  4457558

• feat(decoder): add Qwen2 modeling code

  dacorvo

  committed
  bb05b89

• feat(decoder): allow export from local class

  dacorvo

  committed
  b7adfe0

Commits on Dec 3, 2024

• refactor(exporters): isolate decoder export configs

  Show description for 2afc69d
  dacorvo

  committed
  2afc69d

• feat(export): add support for Qwen2

  dacorvo

  committed
  d0f1ebc

• test(decoder): add Qwen2

  dacorvo

  committed
  bd9dd97

• test(tgi): add Qwen2 tests

  dacorvo

  committed
  c61cadd

• perf: add QwenMath accuracy example results

  dacorvo

  committed
  ddc084b

• perf(tgi): add Qwen2.5-7b performances

  dacorvo

  committed
  1c831a7

Commits on Dec 4, 2024

• review: add type annotations

  dacorvo

  committed
  113810e

Commits on Dec 5, 2024

• review: add comments in Qwen2ForSampling

  dacorvo

  committed
  6012a37