Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] 支持基于ray的多卡多机评测 #1804

Open
1 task
wenxueru opened this issue Jan 4, 2025 · 1 comment
Open
1 task

[Feature] 支持基于ray的多卡多机评测 #1804

wenxueru opened this issue Jan 4, 2025 · 1 comment
Assignees
@tonysy

Comments

@wenxueru
Copy link

wenxueru commented Jan 4, 2025

Describe the feature

  • 在一些平台上slurm不便于使用
  • 基于ray能方便的组集群进行大规模大模型的测评

Will you implement it?

  • I would like to implement this feature and create a PR!
@tonysy
Copy link
Collaborator

tonysy commented Jan 7, 2025

We currently support VOLC for ByteDance cluster, DLC for Aliyun PAI cluster. You can implement a new runner for Ray. Also welcome to contribute your implementation into OpenCompass.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@tonysy tonysy

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@tonysy @wenxueru