Skip to content

Commit ec48716

Browse files
committed
update README
Signed-off-by: Mustafa <[email protected]>
1 parent c06578e commit ec48716

File tree

1 file changed

+7
-7
lines changed
  • FinanceAgent/docker_compose/intel/hpu/gaudi

1 file changed

+7
-7
lines changed

FinanceAgent/docker_compose/intel/hpu/gaudi/README.md

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ This README provides instructions for deploying the Finance Agent application us
55

66
- [Overview](#overview)
77
- [Prerequisites](#prerequisites)
8-
- [Quick Start Deployment](#quick-start-deployment)
8+
- [Start Deployment](#start-deployment)
99
- [Building Custom Images (Optional)](#building-custom-images-optional)
1010
- [Validate Services](#validate-services)
1111
- [Accessing the User Interface (UI)](#accessing-the-user-interface-ui)
@@ -31,9 +31,9 @@ Clone the GenAIExamples repository:
3131
cd GenAIExamples/FinanceAgent/docker_compose/intel/hpu/gaudi
3232
```
3333

34-
## Quick Start Deployment
35-
This uses the default vLLM-based deployment profile (finance-gaudi-vllm).
36-
## Configure Environment
34+
## Start Deployment
35+
This uses the default vLLM-based deployment profile (vllm-gaudi-server).
36+
### Configure Environment
3737
Set required environment variables in your shell:
3838

3939
```shell
@@ -59,8 +59,8 @@ Set required environment variables in your shell:
5959

6060
Note: The compose file might read additional variables from set_env.sh. Ensure all required variables like ports (LLM_SERVICE_PORT, TEI_EMBEDDER_PORT, etc.) are set if not using defaults from the compose file. For instance, edit the set_env.sh to change the LLM model:
6161

62-
## Start Services
63-
### Deploy with Docker Compose
62+
### Start Services
63+
#### Deploy with Docker Compose
6464
Below is the command to launch services
6565
- vllm-gaudi-server
6666
- tei-embedding-serving
@@ -78,7 +78,7 @@ Below is the command to launch services
7878
docker compose up -d
7979
```
8080

81-
### [Optional] Build docker images
81+
#### [Optional] Build docker images
8282

8383
Only needed when docker pull failed.
8484

0 commit comments

Comments
 (0)