You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
-[Accessing the User Interface (UI)](#accessing-the-user-interface-ui)
@@ -31,9 +31,9 @@ Clone the GenAIExamples repository:
31
31
cd GenAIExamples/FinanceAgent/docker_compose/intel/hpu/gaudi
32
32
```
33
33
34
-
## Quick Start Deployment
35
-
This uses the default vLLM-based deployment profile (finance-gaudi-vllm).
36
-
## Configure Environment
34
+
## Start Deployment
35
+
This uses the default vLLM-based deployment profile (vllm-gaudi-server).
36
+
###Configure Environment
37
37
Set required environment variables in your shell:
38
38
39
39
```shell
@@ -59,8 +59,8 @@ Set required environment variables in your shell:
59
59
60
60
Note: The compose file might read additional variables from set_env.sh. Ensure all required variables like ports (LLM_SERVICE_PORT, TEI_EMBEDDER_PORT, etc.) are set if not using defaults from the compose file. For instance, edit the set_env.sh to change the LLM model:
61
61
62
-
## Start Services
63
-
### Deploy with Docker Compose
62
+
###Start Services
63
+
####Deploy with Docker Compose
64
64
Below is the command to launch services
65
65
- vllm-gaudi-server
66
66
- tei-embedding-serving
@@ -78,7 +78,7 @@ Below is the command to launch services
0 commit comments