Popular repositories Loading

1. ComfyUI-flash-attention-triton ComfyUI-flash-attention-triton Public

   A ComfyUI node that allows you to select Flash Attention Triton implementation as sampling attention.

   Python 2

2. exllama exllama Public

   Forked from turboderp/exllama

   A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

   Python 1

3. text-generation-webui text-generation-webui Public

   Forked from oobabooga/text-generation-webui

   A gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA.

   Python

4. whisper.cpp whisper.cpp Public

   Forked from ggerganov/whisper.cpp

   Port of OpenAI's Whisper model in C/C++

   C

5. exllamav2 exllamav2 Public

   Forked from turboderp-org/exllamav2

   A fast inference library for running LLMs locally on modern consumer-class GPUs

   Python

6. llama.cpp llama.cpp Public

   Forked from ggerganov/llama.cpp

   Port of Facebook's LLaMA model in C/C++

   C