Skip to content

repositories Search Results · repo:b4rtaz/distributed-llama language:C++

Filter by

0 files
 (123 ms)

0 files

inb4rtaz/distributed-llama (press backspace or delete to remove)

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
  • C++
  • 2.6k
  • Updated
    yesterday
Package icon

Sponsor open source projects you depend on

Contributors are working behind the scenes to make open source better for everyone—give them the help and recognition they deserve.Explore sponsorable projects
ProTip! 
Press the
/
key to activate the search input again and adjust your query.
Package icon

Sponsor open source projects you depend on

Contributors are working behind the scenes to make open source better for everyone—give them the help and recognition they deserve.Explore sponsorable projects
ProTip! 
Press the
/
key to activate the search input again and adjust your query.