Skip to content

Commit

Permalink
more perfo with llamafile tinyblas on x86_64.
Browse files Browse the repository at this point in the history
- add bf16 suport
- change dispache strategie (thanks:
ikawrakow/ik_llama.cpp#71 )
- reduce memory bandwidth

simple tinyblas dispache and more cache freindly
  • Loading branch information
Djip007 committed Dec 11, 2024
1 parent 43041d2 commit 01ba9f5
Showing 1 changed file with 214 additions and 226 deletions.
Loading

0 comments on commit 01ba9f5

Please sign in to comment.