Has anybody evaluated the deepspeed inference model? #3674
yuchen2580
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Has anybody ever tested the ppl accuracy for any models on huggingface with deepspeed inference?
I did but it seems the accuracy dropped significantly.
I posted the issue here:
#3511
Beta Was this translation helpful? Give feedback.
All reactions