Skip to content

Fix #1344 Extend e2e tests to add asym support for W8A8-Int8 #1345

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Fix #1344 Extend e2e tests to add asym support for W8A8-Int8 #1345

wants to merge 2 commits into from

Conversation

ved1beta
Copy link

@ved1beta ved1beta commented Apr 11, 2025 •
edited
Loading

SUMMARY:
Add e2e test configs for W8A8-int8 with asymmetric activations

Added two new test configurations to cover recipes with W8A8-int8 asymmetric activations:

  • One config for dynamic asymmetric activations (group_1)
  • One config for static asymmetric activations (group_2)
    Preserved the original group_0 configuration to maintain backward compatibility.

TEST PLAN:

  • Verified configs match the W8A8-int8 asymmetric activation requirements
  • Ensured compatibility with the existing SmoothQuantModifier settings
  • Confirmed these configs will run on the nightly cadence alongside existing e2e tests
  • Will monitor initial runs to verify proper uploading and verification in vLLM

fixes #1344

@ved1beta ved1beta changed the title Extend e2e tests to add asym support for W8A8-Int8 Fix #1344 Extend e2e tests to add asym support for W8A8-Int8 Apr 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Extend e2e tests to add asym support for W8A8-Int8
1 participant
@ved1beta