-
Notifications
You must be signed in to change notification settings - Fork 337
Open
Description
Both ONNX and OCP MXFP requires the first element in LSB.
- https://onnx.ai/onnx/technical/float4.html
- https://onnx.ai/onnx/technical/int4.html
- https://triton-lang.org/main/python-api/generated/triton.language.dot_scaled.html#triton.language.dot_scaled
But torchao packs the second element in LSB:
https://github.com/pytorch/ao/blob/main/torchao/prototype/mx_formats/kernels.py#L761
Metadata
Metadata
Assignees
Labels
No labels