Skip to content

Add Qwen 3.7 Plus benchmark profile - #27

Merged
qinxuye merged 1 commit into
mainfrom
agent/add-qwen-3-7-plus-profile
Jul 26, 2026
Merged

Add Qwen 3.7 Plus benchmark profile#27
qinxuye merged 1 commit into
mainfrom
agent/add-qwen-3-7-plus-profile

Conversation

@qinxuye

@qinxuye qinxuye commented Jul 26, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • add a bundled qwen/qwen3.7-plus model profile with canonical OpenRouter ID, aliases, context/output limits, pricing, and source links
  • record GPQA Diamond 90.0 from Artificial Analysis
  • preserve LiveCodeBench as missing because neither Artificial Analysis nor Vals currently publishes a result for this model
  • add registry regression coverage for profile count, alias resolution, provenance, and benchmark availability

Why

The router uses gpqa_diamond and livecodebench as its capability inputs. Qwen 3.7 Plus is now available through OpenRouter, so adding its sourced profile enables deployment use without substituting unrelated coding benchmarks for the still-missing LiveCodeBench result.

This change adds the model to the registry only; it does not add it to an auto router candidate set.

Validation

  • XROUTER_LLM_ENTERPRISE_DISABLE_AUTOPATCH=1 PYTHONPATH=src python -m pytest -q — 81 passed, 21 skipped
  • PYTHONPATH=src python -m compileall -q src tests
  • git diff --check
  • repository secret scan

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request adds a new YAML configuration file for the qwen/qwen3.7-plus model, specifying its metadata, costs, and benchmark scores. It also updates the corresponding test suite in tests/test_yaml_profiles.py to verify that the new model profile is loaded correctly with the expected attributes. There are no review comments, so no additional feedback is provided.

@qinxuye
qinxuye merged commit f891ae4 into main Jul 26, 2026
4 checks passed
@qinxuye
qinxuye deleted the agent/add-qwen-3-7-plus-profile branch July 26, 2026 08:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant