Skip to content

Commit 84afaa2

Browse files
committed
Fix after merge
1 parent c0661c2 commit 84afaa2

File tree

2 files changed

+2
-1
lines changed

2 files changed

+2
-1
lines changed

src/common/schema.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -34,6 +34,7 @@
3434
"google_vertexai",
3535
"groq",
3636
"huggingface",
37+
"meta-llama",
3738
"mistralai",
3839
"ollama",
3940
"openai",

src/server/bootstrap/models.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -103,7 +103,7 @@ def update_env_var(model: Model, provider: str, model_key: str, env_var: str):
103103
"type": "ll",
104104
"provider": "meta-llama",
105105
"api_key": "",
106-
"url": os.environ.get("ON_PREM_VLLM_URL", default="http://gpu:8000/v1"),
106+
"api_base": os.environ.get("ON_PREM_VLLM_URL", default="http://gpu:8000/v1"),
107107
"context_length": 131072,
108108
"temperature": 1.0,
109109
"max_completion_tokens": 2048,

0 commit comments

Comments
 (0)