Skip to content

Commit e6039b8

Browse files
committed
update readme files
Signed-off-by: Mustafa <[email protected]>
1 parent 9e84e73 commit e6039b8

File tree

3 files changed

+19
-16
lines changed

3 files changed

+19
-16
lines changed

CodeGen/README.md

Lines changed: 17 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -148,34 +148,39 @@ To set up environment variables for deploying ChatQnA services, follow these ste
148148

149149
#### Deploy CodeGen on Gaudi
150150

151-
Find the corresponding [compose.yaml](./docker_compose/intel/hpu/gaudi/compose.yaml).
151+
Find the corresponding [compose.yaml](./docker_compose/intel/hpu/gaudi/compose.yaml). User could start CodeGen based on TGI or vLLM service:
152152

153153
```bash
154154
cd GenAIExamples/CodeGen/docker_compose/intel/hpu/gaudi
155-
docker compose up -d
155+
```
156+
157+
TGI service:
158+
```bash
159+
docker compose --profile codegen-xeon-tgi up -d
160+
```
161+
162+
vLLM service:
163+
```bash
164+
docker compose --profile codegen-xeon-vllm up -d
156165
```
157166

158167
Refer to the [Gaudi Guide](./docker_compose/intel/hpu/gaudi/README.md) to build docker images from source.
159168

160169
#### Deploy CodeGen on Xeon
161170

162-
Find the corresponding [compose.yaml](./docker_compose/intel/cpu/xeon/compose.yaml).
171+
Find the corresponding [compose.yaml](./docker_compose/intel/cpu/xeon/compose.yaml). User could start CodeGen based on TGI or vLLM service:
163172

164-
Start CodeGen based on TGI service:
173+
```bash
174+
cd GenAIExamples/CodeGen/docker_compose/intel/cpu/xeon
175+
```
165176

177+
TGI service:
166178
```bash
167-
cd GenAIExamples/CodeGen/docker_compose
168-
source set_env.sh
169-
cd intel/cpu/xeon
170179
docker compose --profile codegen-xeon-tgi up -d
171180
```
172181

173-
Start CodeGen based on vLLM service:
174-
182+
vLLM service:
175183
```bash
176-
cd GenAIExamples/CodeGen/docker_compose
177-
source set_env.sh
178-
cd intel/cpu/xeon
179184
docker compose --profile codegen-xeon-vllm up -d
180185
```
181186

CodeGen/codegen.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -23,13 +23,10 @@
2323
logflag = os.getenv("LOGFLAG", False)
2424

2525
MEGA_SERVICE_PORT = int(os.getenv("MEGA_SERVICE_PORT", 7778))
26-
2726
LLM_SERVICE_HOST_IP = os.getenv("LLM_SERVICE_HOST_IP", "0.0.0.0")
2827
LLM_SERVICE_PORT = int(os.getenv("LLM_SERVICE_PORT", 9000))
29-
3028
RETRIEVAL_SERVICE_HOST_IP = os.getenv("RETRIEVAL_SERVICE_HOST_IP", "0.0.0.0")
3129
REDIS_RETRIEVER_PORT = int(os.getenv("REDIS_RETRIEVER_PORT", 7000))
32-
3330
TEI_EMBEDDING_HOST_IP = os.getenv("TEI_EMBEDDING_HOST_IP", "0.0.0.0")
3431
EMBEDDER_PORT = int(os.getenv("EMBEDDER_PORT", 6000))
3532

CodeGen/docker_compose/intel/cpu/xeon/compose.yaml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -197,4 +197,5 @@ services:
197197
restart: unless-stopped
198198
networks:
199199
default:
200-
driver: bridge
200+
driver: bridge
201+

0 commit comments

Comments
 (0)