You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I want to try the demo in READMD using falcon-40b model to compare with llama.cpp.But I don't know which model version should I use in llama.cpp. Relu version(PowerInfer/ReluFalcon-40B-PowerInfer-GGUF) or the original model(tiiuae/falcon-40b)?
Additional Context
Thank you very much!
The text was updated successfully, but these errors were encountered:
Prerequisites
Before submitting your question, please ensure the following:
Question Details
I want to try the demo in READMD using falcon-40b model to compare with llama.cpp.But I don't know which model version should I use in llama.cpp. Relu version(PowerInfer/ReluFalcon-40B-PowerInfer-GGUF) or the original model(tiiuae/falcon-40b)?
Additional Context
Thank you very much!
The text was updated successfully, but these errors were encountered: