-
Notifications
You must be signed in to change notification settings - Fork 2.9k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[Quant tool] Fix quantized bias's scale dtype to properly handle fp16…
… bias inputs (#20340) ### Description - Fix quantization tool bug that did not correctly set a quantized bias's scale data type to fp16 if the original bias was fp16. - Enabled fp16 ConvTranspose quantization unit tests that were disabled. ### Motivation and Context Python quantization tests for fp16 ConvTranspose were originally disabled due to a shape inference bug. It turns out that we also have a bug in our quantizer that does not properly handle fp16 bias inputs. Fixing the bug allows us to re-enable these tests with the latest version of ONNX.
- Loading branch information
1 parent
0a19025
commit eae7b70
Showing
2 changed files
with
4 additions
and
4 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters