Skip to content

Commit daf7e76

Browse files
authored
docs: add examples of Novita AI and DeepSeek llms (#603)
Close #584 and #593. The interfaces have been tested compatible with `LLMProvider.OPENAI_LIKE`.
1 parent 1e671f3 commit daf7e76

File tree

1 file changed

+29
-0
lines changed

1 file changed

+29
-0
lines changed

frontend/app/src/pages/docs/llm.mdx

+29
Original file line numberDiff line numberDiff line change
@@ -119,13 +119,16 @@ To learn more about vLLM, please visit [vLLM](https://docs.vllm.ai/en/stable/).
119119

120120
#### Xinference
121121

122+
If you assigned a model uid different from the model name, you need to fill in **model uid** in the box `model`.
123+
122124
Default config:
123125

124126
```json
125127
{
126128
"api_base": "http://localhost:9997/v1/"
127129
}
128130
```
131+
129132
To learn more about Xinference, please visit [Xinference](https://inference.readthedocs.io/en/latest/).
130133

131134

@@ -154,3 +157,29 @@ Do not mix `Model version` and `API version` up, they are different.
154157

155158
![Azure OpenAI Service Deployment Tab - LLM](https://github.com/user-attachments/assets/158f845c-5f38-40d7-b66a-8528d7df178e)
156159

160+
#### Novita AI
161+
162+
Default config:
163+
164+
```json
165+
{
166+
"api_base": "https://api.novita.ai/v3/openai"
167+
}
168+
```
169+
170+
To learn more about Novita AI, please visit [Novita AI](https://novita.ai/).
171+
172+
#### DeepSeek
173+
174+
DeepSeek provides chat model `deepseek-chat`.
175+
176+
Default config:
177+
178+
```json
179+
{
180+
"api_base": "https://api.deepseek.com/v1",
181+
"is_chat_model": true
182+
}
183+
```
184+
185+
To learn more about DeepSeek, please visit [DeepSeek](https://www.deepseek.com/).

0 commit comments

Comments
 (0)