Skip to content

Commit c5ccb28

Browse files
committed
update readme
Signed-off-by: Mustafa <[email protected]>
1 parent 0b34fe5 commit c5ccb28

File tree

1 file changed

+17
-12
lines changed

1 file changed

+17
-12
lines changed

CodeGen/README.md

Lines changed: 17 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -148,34 +148,39 @@ To set up environment variables for deploying ChatQnA services, follow these ste
148148

149149
#### Deploy CodeGen on Gaudi
150150

151-
Find the corresponding [compose.yaml](./docker_compose/intel/hpu/gaudi/compose.yaml).
151+
Find the corresponding [compose.yaml](./docker_compose/intel/hpu/gaudi/compose.yaml). User could start CodeGen based on TGI or vLLM service:
152152

153153
```bash
154154
cd GenAIExamples/CodeGen/docker_compose/intel/hpu/gaudi
155-
docker compose up -d
155+
```
156+
157+
TGI service:
158+
```bash
159+
docker compose --profile codegen-xeon-tgi up -d
160+
```
161+
162+
vLLM service:
163+
```bash
164+
docker compose --profile codegen-xeon-vllm up -d
156165
```
157166

158167
Refer to the [Gaudi Guide](./docker_compose/intel/hpu/gaudi/README.md) to build docker images from source.
159168

160169
#### Deploy CodeGen on Xeon
161170

162-
Find the corresponding [compose.yaml](./docker_compose/intel/cpu/xeon/compose.yaml).
171+
Find the corresponding [compose.yaml](./docker_compose/intel/cpu/xeon/compose.yaml). User could start CodeGen based on TGI or vLLM service:
163172

164-
Start CodeGen based on TGI service:
173+
```bash
174+
cd GenAIExamples/CodeGen/docker_compose/intel/cpu/xeon
175+
```
165176

177+
TGI service:
166178
```bash
167-
cd GenAIExamples/CodeGen/docker_compose
168-
source set_env.sh
169-
cd intel/cpu/xeon
170179
docker compose --profile codegen-xeon-tgi up -d
171180
```
172181

173-
Start CodeGen based on vLLM service:
174-
182+
vLLM service:
175183
```bash
176-
cd GenAIExamples/CodeGen/docker_compose
177-
source set_env.sh
178-
cd intel/cpu/xeon
179184
docker compose --profile codegen-xeon-vllm up -d
180185
```
181186

0 commit comments

Comments
 (0)