[Bug] keep restarting failed container model-downloader in pod chatqna-teirerank, chatqna-tei for ChatQnA

[louie-tsai]

Priority

P2-High

OS type

Ubuntu

Hardware type

Xeon-GNR

Installation method

• Pull docker images from hub.docker.com
• Build docker images from source
• Other
• N/A

Deploy method

• Kubernetes Helm Charts
• Kubernetes GMC
• Other
• N/A

Running nodes

Single Node

What's the version?

the latest main branch

Description

trying ChatQnA on customer K8s cluster, but keep restarting failed container model-downloader in pod chatqna-teirerank, chatqna-tei for ChatQnA.

following the instruction for Xeon, but facing model-download issue.
https://github.com/opea-project/GenAIInfra/tree/main/helm-charts/chatqna#installing-the-chart

Reproduce steps

following instructions for ChatQnA with vLLM on Xeon
https://github.com/opea-project/GenAIInfra/tree/main/helm-charts/chatqna#installing-the-chart

Raw log

Attachments

No response

[lianhao]

Could you please paste the log of 'kubectl -n log -c model-downloader'?

[louie-tsai]

thanks. saw the issue from the model downloader container.

[louie-tsai]

Fixed with below PR.
[#1164]
#1164