Skip to content

Conversation

@rillomas
Copy link
Contributor

Not sure if this was intended but the original MUL_MAT_ID perf tests were replaced by MUL_MAT_ID_FUSION tests at #17095, and MUL_MAT_ID cannot be measured by test-backend-ops perf -o MUL_MAT_ID at the moment. We'd like to revive this since it is actively used in models like gpt-oss (until it is fully replaced by MUL_MAT_ID_FUSION ops?)

@rillomas rillomas requested a review from slaren as a code owner November 20, 2025 07:39
@github-actions github-actions bot added the testing Everything test related label Nov 20, 2025
@0cc4m
Copy link
Collaborator

0cc4m commented Nov 20, 2025

You're right. they shouldn't have been removed. But instead of duplicating the loops, please just put the original test_mul_mat_id call next to the new test_mul_mat_id_fusion call.

@rillomas rillomas force-pushed the revive-mul-mat-id-perf-test branch from f4d4327 to 72bad37 Compare November 21, 2025 03:41
@rillomas
Copy link
Contributor Author

Thanks for your review. I updated the code to reuse the loop.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

testing Everything test related

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants