Skip to content

Commit

Permalink
more perfo with llamafile tinyblas on x86_64.
Browse files Browse the repository at this point in the history
- add bf16 suport
- change dispache strategie (thanks:
ikawrakow/ik_llama.cpp#71 )
- reduce memory bandwidth

simple tinyblas dispache and more cache freindly
  • Loading branch information
Djip007 committed Dec 8, 2024
1 parent 19d8762 commit f7c5a68
Showing 1 changed file with 206 additions and 224 deletions.
Loading

0 comments on commit f7c5a68

Please sign in to comment.