MatMulNBits 8 bits support #20952
Positronx
started this conversation in
Ideas / Feature Requests
MatMulNBits 8 bits support
#20952
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Can MatMulNBits handle a number of bits other than 4 (e.g. 8 bits)? If not, is there a plan to add this feature?
Beta Was this translation helpful? Give feedback.
All reactions