Skip to content

Commit

Permalink
Update providers.md Open WebUI
Browse files Browse the repository at this point in the history
  • Loading branch information
rjmacarthy committed Apr 19, 2024
1 parent 3aae321 commit 59faa50
Showing 1 changed file with 7 additions and 5 deletions.
12 changes: 7 additions & 5 deletions docs/providers.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,21 +19,23 @@ These example configurations serve as a starting point. Individual adjustments m
- **Path:** `/v1/chat/completions`
- **Model Name:** `codellama:7b-instruct` or any effective instruct model

### Ollama Web UI
### Open WebUI

Open WebUI can be used a proxy API for twinny, simply configure the endpoint to match what is served by OpenWeb UI.

#### FIM (Auto-complete)

- **Hostname:** `localhost`
- **Port:** `11434`
- **Path:** `/ollama/api/generate`
- **Port:** Check documentation
- **Path:** Check documentation
- **Model Name:** `codellama:7b-code`
- **FIM Template:** Use the template corresponding to your model, similar to the desktop configuration.

#### Chat Configuration

- **Hostname:** `localhost`
- **Port:** `11434`
- **Path:** `/ollama/v1/chat/completions`
- **Port:** Check documentation
- **Path:** Check documentation
- **Model Name:** `codellama:7b-instruct` or another reliable instruct model

### LM Studio
Expand Down

0 comments on commit 59faa50

Please sign in to comment.