Skip to content
This repository has been archived by the owner on Jun 24, 2024. It is now read-only.

Latest commit

 

History

History
48 lines (31 loc) · 1.66 KB

known-good-models.md

File metadata and controls

48 lines (31 loc) · 1.66 KB

Known-good models

The following models have been tested and are known to work with llm.

Models are distributed as single files, but come in a variety of quantization levels. You will need to select the quantization level that is appropriate for your application. For more information, see Getting Models in the README.

The LLaMA architecture is the most well-supported.

LLaMA

We have chosen not to include any models based on the original LLaMA model due to licensing concerns. However, the OpenLLaMA models are available under the Apache 2.0 license and are compatible with llm.

Models based on the original LLaMA model are also compatible, but you will need to find them yourselves due to their licensing.

GPT-2

GPT-J

MPT

GPT-NeoX/RedPajama

BLOOM