You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When I start the server in persistent mode, it runs very well. However, when I open the client, it reports the following error.
Traceback (most recent call last):
File "/root/miniconda3/lib/python3.11/site-packages/mii/config.py", line 392, in get_mii_config
mii_config = import_score_file(deployment_name, DeploymentType.LOCAL).mii_config
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/lib/python3.11/site-packages/mii/utils.py", line 111, in import_score_file
spec.loader.exec_module(score)
File "", line 936, in exec_module
File "", line 1073, in get_code
File "", line 1130, in get_data
FileNotFoundError: [Errno 2] No such file or directory: '/root/autodl-tmp/hf/hub/Qwen1.5-7B/score.py'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/root/miniconda3/lib/python3.11/site-packages/mii/config.py", line 397, in get_mii_config
mii_config = import_score_file(deployment_name,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/lib/python3.11/site-packages/mii/utils.py", line 111, in import_score_file
spec.loader.exec_module(score)
File "", line 936, in exec_module
File "", line 1073, in get_code
File "", line 1130, in get_data
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/mii_cache/Qwen1.5-7B-mii-deployment/score.py'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/root/autodl-tmp/llm/LLM-quickstart/deepspeed/vs/client2-7b.py", line 6, in
client = mii.client(model_path)
^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/lib/python3.11/site-packages/mii/api.py", line 109, in client
mii_config = get_mii_config(model_or_deployment_name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/lib/python3.11/site-packages/mii/config.py", line 400, in get_mii_config
raise DeploymentNotFoundError(
mii.errors.DeploymentNotFoundError: Could not find a deployment named /root/autodl-tmp/hf/hub/Qwen1.5-7B or Qwen1.5-7B-mii-deployment
When I use curl to access the server, it returns results normally.
How should I troubleshoot the problem?
The text was updated successfully, but these errors were encountered:
When I start the server in persistent mode, it runs very well. However, when I open the client, it reports the following error.
When I use curl to access the server, it returns results normally.
How should I troubleshoot the problem?
The text was updated successfully, but these errors were encountered: