Skip to content

Commit 6d7f9d7

Browse files
authored
Fix retriever top_k env variable assignment (#28)
Signed-off-by: Shubhadeep Das <[email protected]>
1 parent 3732748 commit 6d7f9d7

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

deploy/compose/docker-compose-rag-server.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,7 @@ services:
3232
COLLECTION_NAME: ${COLLECTION_NAME:-multimodal_data}
3333
APP_RETRIEVER_SCORETHRESHOLD: 0.25
3434
# Top K from vector DB, which goes as input to reranker model if enabled, else goes to LLM prompt
35-
VECTOR_DB_TOPK: 100
35+
VECTOR_DB_TOPK: ${VECTOR_DB_TOPK:-100}
3636

3737
##===LLM Model specific configurations===
3838
APP_LLM_MODELNAME: ${APP_LLM_MODELNAME:-"nvidia/llama-3.3-nemotron-super-49b-v1"}
@@ -58,7 +58,7 @@ services:
5858
NVIDIA_API_KEY: ${NGC_API_KEY:?"NGC_API_KEY is required"}
5959

6060
# Number of document chunks to insert in LLM prompt, used only when ENABLE_RERANKER is set to True
61-
APP_RETRIEVER_TOPK: 10
61+
APP_RETRIEVER_TOPK: ${APP_RETRIEVER_TOPK:-10}
6262

6363
# Log level for server, supported level NOTSET, DEBUG, INFO, WARN, ERROR, CRITICAL
6464
LOGLEVEL: ${LOGLEVEL:-INFO}

0 commit comments

Comments
 (0)