You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Since backend was originally inherited from upstream, along with age in the very rapidly evolving llama.cpp, it would make sense to re-write FLlama to use unreal threading and queue structure along with cleaner and more modern llama.cpp API (see updated examples).
The text was updated successfully, but these errors were encountered:
Since backend was originally inherited from upstream, along with age in the very rapidly evolving llama.cpp, it would make sense to re-write FLlama to use unreal threading and queue structure along with cleaner and more modern llama.cpp API (see updated examples).
The text was updated successfully, but these errors were encountered: