Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

多机多卡推理 #44

Open
zhudongwork opened this issue Dec 12, 2023 · 4 comments
Open

多机多卡推理 #44

zhudongwork opened this issue Dec 12, 2023 · 4 comments

Comments

@zhudongwork
Copy link

大佬，支持同一个集群里面的多机多卡推理不
@Tlntin
Copy link
Owner

Tlntin commented Dec 12, 2023

理论可以，我没测试过。

@zhudongwork
Copy link
Author

多机多卡的话是不是就不能用docker了，直接在宿主机上装环境

@Tlntin
Copy link
Owner

Tlntin commented Dec 13, 2023

不确定，去官方仓库看了一下，暂时没有多机多卡的成功案例，可能还不支持。

@chwma0
Copy link

chwma0 commented Nov 11, 2024 •
edited
Loading

单机多卡可以吗？
我这里单机双卡部署可以成功，但是好像推理结果和单卡并不对齐...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@Tlntin @zhudongwork @chwma0