@@ -84,19 +84,19 @@ print(response) # ['Riga', 'Tallinn']
8484
8585In alphabetical order:
8686
87- | | [ Anthropic] ( ../../models/anthropic ) | [ Dottxt] ( ../../models/dottxt ) | [ Gemini] ( ../../models/gemini ) | [ LlamaCpp] ( ../../models/llamacpp ) | [ MLXLM] ( ../../models/mlxlm ) | [ Ollama] ( ../../models/ollama ) | [ OpenAI] ( ../../models/openai ) | [ SGLang] ( ../../models/sglang ) | [ TGI] ( ../../models/tgi ) | [ Transformers] ( ../../models/transformers ) | [ Transformers MultiModal] ( ../../models/transformers_multimodal ) | [ VLLM] ( ../../models/vllm ) | [ VLLMOffline] ( ../../models/vllm_offline ) |
88- | ---| ---| ---| ---| ---| ---| ---| ---| ---| ---| ---| ---| ---| ---|
89- | ** Output Types** | | | | | | | | | | | | | |
90- | Simple Types | ❌ | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
91- | JSON Schema | ❌ | ✅ | 🟠 | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
92- | Multiple Choice | ❌ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
93- | Regex | ❌ | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
94- | Grammar | ❌ | ❌ | ❌ | ❌ | ✅ | ❌ | ❌ | 🟠 | ❌ | ✅ | ✅ | ✅ | ✅ |
95- | ** Generation Features** | | | | | | | | | | | | | |
96- | Async | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ | ✅ | ❌ |
97- | Streaming | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ | ✅ | ❌ |
98- | Vision | ✅ | ❌ | ✅ | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ | ✅ | ❌ | ❌ |
99- | Batching | ❌ | ❌ | ❌ | ❌ | ✅ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ❌ | ✅ |
87+ | | [ Anthropic] ( ../../models/anthropic ) | [ Dottxt] ( ../../models/dottxt ) | [ Gemini] ( ../../models/gemini ) | [ LlamaCpp] ( ../../models/llamacpp ) | [ MLXLM] ( ../../models/mlxlm ) | [ Mistral ] ( ../../models/mistral ) | [ Ollama] ( ../../models/ollama ) | [ OpenAI] ( ../../models/openai ) | [ SGLang] ( ../../models/sglang ) | [ TGI] ( ../../models/tgi ) | [ Transformers] ( ../../models/transformers ) | [ Transformers MultiModal] ( ../../models/transformers_multimodal ) | [ VLLM] ( ../../models/vllm ) | [ VLLMOffline] ( ../../models/vllm_offline ) |
88+ | ---| ---| ---| ---| ---| ---| ---| ---| ---| ---| ---| ---| ---| ---| --- |
89+ | ** Output Types** | | | | | | | | | | | | | | |
90+ | Simple Types | ❌ | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
91+ | JSON Schema | ❌ | ✅ | 🟠 | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
92+ | Multiple Choice | ❌ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
93+ | Regex | ❌ | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
94+ | Grammar | ❌ | ❌ | ❌ | ❌ | ✅ | ❌ | ❌ | ❌ | 🟠 | ❌ | ✅ | ✅ | ✅ | ✅ |
95+ | ** Generation Features** | | | | | | | | | | | | | | |
96+ | Async | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ | ✅ | ❌ |
97+ | Streaming | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ | ✅ | ❌ |
98+ | Vision | ✅ | ❌ | ✅ | ❌ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ✅ | ❌ | ❌ |
99+ | Batching | ❌ | ❌ | ❌ | ❌ | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ❌ | ✅ |
100100
101101## Model Types
102102
@@ -119,6 +119,7 @@ The server-based models available are the following:
119119- Anthropic
120120- Dottxt
121121- Gemini
122+ - Mistral
122123- Ollama
123124- OpenAI
124125- SgLang
@@ -141,6 +142,7 @@ print(type(model)) # outlines.models.tgi.AsyncTGI
141142
142143The models that have an async version are the following:
143144
145+ - Mistral
144146- Ollama
145147- OpenAI
146148- SgLang
0 commit comments