File tree Expand file tree Collapse file tree 1 file changed +17
-12
lines changed
Expand file tree Collapse file tree 1 file changed +17
-12
lines changed Original file line number Diff line number Diff line change @@ -148,34 +148,39 @@ To set up environment variables for deploying ChatQnA services, follow these ste
148148
149149#### Deploy CodeGen on Gaudi
150150
151- Find the corresponding [ compose.yaml] ( ./docker_compose/intel/hpu/gaudi/compose.yaml ) .
151+ Find the corresponding [ compose.yaml] ( ./docker_compose/intel/hpu/gaudi/compose.yaml ) . User could start CodeGen based on TGI or vLLM service:
152152
153153``` bash
154154cd GenAIExamples/CodeGen/docker_compose/intel/hpu/gaudi
155- docker compose up -d
155+ ```
156+
157+ TGI service:
158+ ``` bash
159+ docker compose --profile codegen-xeon-tgi up -d
160+ ```
161+
162+ vLLM service:
163+ ``` bash
164+ docker compose --profile codegen-xeon-vllm up -d
156165```
157166
158167Refer to the [ Gaudi Guide] ( ./docker_compose/intel/hpu/gaudi/README.md ) to build docker images from source.
159168
160169#### Deploy CodeGen on Xeon
161170
162- Find the corresponding [ compose.yaml] ( ./docker_compose/intel/cpu/xeon/compose.yaml ) .
171+ Find the corresponding [ compose.yaml] ( ./docker_compose/intel/cpu/xeon/compose.yaml ) . User could start CodeGen based on TGI or vLLM service:
163172
164- Start CodeGen based on TGI service:
173+ ``` bash
174+ cd GenAIExamples/CodeGen/docker_compose/intel/cpu/xeon
175+ ```
165176
177+ TGI service:
166178``` bash
167- cd GenAIExamples/CodeGen/docker_compose
168- source set_env.sh
169- cd intel/cpu/xeon
170179docker compose --profile codegen-xeon-tgi up -d
171180```
172181
173- Start CodeGen based on vLLM service:
174-
182+ vLLM service:
175183``` bash
176- cd GenAIExamples/CodeGen/docker_compose
177- source set_env.sh
178- cd intel/cpu/xeon
179184docker compose --profile codegen-xeon-vllm up -d
180185```
181186
You can’t perform that action at this time.
0 commit comments