-
Notifications
You must be signed in to change notification settings - Fork 478
the model name of glmocr package in selfhosted always default #159
Copy link
Copy link
Closed
Description
System Info / 系統信息
I launched glm-ocr model with vllm 0.17.0, then I use code as
with GlmOcr(ocr_api_host="localhost", ocr_api_port=8765, model="glm-ocr", mode="selfhosted", log_level="DEBUG") as parser:But I still get error like below:
Exception: OCR request failed: {'error': 'API request failed', 'status_code': 404, 'response': '{"error":{"message":"The model `default` does not exist.","type":"NotFoundError","param":"model","code":404}}'}, status_code: 404Who can help? / 谁可以帮助到您?
No response
Information / 问题信息
- The official example scripts / 官方的示例脚本
- My own modified scripts / 我自己修改的脚本和任务
Reproduction / 复现过程
- pip install "glmocr[selfhosted]"
- launch glm-ocr model use vllm
- test with code like
with GlmOcr(ocr_api_host="localhost", ocr_api_port=8765, model="glm-ocr", mode="selfhosted", log_level="DEBUG") as parser:
Expected behavior / 期待表现
- use model glm-ocr rather default
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels