-
Notifications
You must be signed in to change notification settings - Fork 531
Open
Description
依次部署服务如下
# CUDA_VISIBLE_DEVICES
export HF_ENDPOINT="https://hf-mirror.com"
# ========================== 后端 =============================
# TTS
uvicorn server.tts.tts_server:app --host 0.0.0.0 --port 8001 >>logs/tts.log 2>&1 &
# Digital Human
uvicorn server.digital_human.digital_human_server:app --host 0.0.0.0 --port 8002 >>logs/digitalhuman.log 2>&1 &
# ASR
uvicorn server.asr.asr_server:app --host 0.0.0.0 --port 8003 >>logs/asr.log 2>&1 &
# LLM
export LMDEPLOY_USE_MODELSCOPE=True
export MODELSCOPE_CACHE="./weights/llm_weights"
lmdeploy serve api_server HinGwenWoong/streamer-sales-lelemiao-7b \
--server-port 23333 \
--model-name internlm2 \
--session-len 32768 \
--cache-max-entry-count 0.1 \
--model-format hf >>logs/llm.log 2>&1 &
# 中台 llm + rag + agent
# Agent Key (如果没有请忽略)
# export DELIVERY_TIME_API_KEY="${快递 EBusinessID},${快递 api_key}"
# export WEATHER_API_KEY="${天气 API key}"
uvicorn server.base.base_server:app --host 0.0.0.0 --port 8000 >>logs/agent.log 2>&1 &
# ========================== 前端 =============================l
# 前端
streamlit run app.py --server.address=0.0.0.0 --server.port 7860 >>logs/app.log 2>&1 &
确认各端口都正确启动后,把端口通过ssh转发到本地,尝试使用销冠。
发现如下错误:
在文字生成之后出现:“FileNotFoundError: [Errno 2] No such file or directory: 'work_dirs/tts_wavs/8403c1c6-6125-11ef-91ed-00259d16b898.wav'“
检查后台发现work_dirs/tts_wavs/只有8403c1c6-6125-11ef-91ed-00259d16b898-00000*.wav, 似乎合并步骤并zheng正确的被没运行到。
Metadata
Metadata
Assignees
Labels
No labels