We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
- paddlepaddle: - paddlepaddle-gpu: - paddlenlp:
llm/README.mnd python -m paddle.distributed.launch --gpus "0,1,2,3,4,5,6,7" ./predict/flask_server.py \ --model_name_or_path meta-llama/Llama-2-7b-chat \ --port 8010 \ --flask_port 8011 \ --dtype "float16" 这里建议 port 8011, flask_port 8010,不然按这个 request_flask_server.py 直接跑会报错容易误解
The text was updated successfully, but these errors were encountered:
This issue is stale because it has been open for 60 days with no activity. 当前issue 60天内无活动,被标记为stale。
Sorry, something went wrong.
This issue was closed because it has been inactive for 14 days since being marked as stale. 当前issue 被标记为stale已有14天,即将关闭。
ZHUI
No branches or pull requests
软件环境
详细描述
The text was updated successfully, but these errors were encountered: