Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Prebuilt Docker images with CUDA runtime #4743

Open
stevapple opened this issue May 30, 2024 · 3 comments
Open

[Feature Request] Prebuilt Docker images with CUDA runtime #4743

stevapple opened this issue May 30, 2024 · 3 comments
Labels
enhancement New Enhancement

Comments

@stevapple
Copy link

Is your feature request related to a problem? Please describe

OpenSearch provides built-in ML support through ml-commons plugin. While the plugin provides CUDA integration out of the box, the official Docker images doesn’t have CUDA built-in, so one need to build their own Docker image if they want to use GPU acceleration for machine learning.

Describe the solution you'd like

Add a -cuda variant for OpenSearch’s Docker distribution with CUDA built-in (optionally a -neuron one), and serve it via DockerHub.

Related component

Other

Describe alternatives you've considered

No response

Additional context

No response

@stevapple stevapple added enhancement New Enhancement untriaged Issues that have not yet been triaged labels May 30, 2024
@dblock dblock transferred this issue from opensearch-project/OpenSearch Jun 3, 2024
@prudhvigodithi
Copy link
Collaborator

[Triage]
Thanks @stevapple can you please add more details on this and some helpful links.
Thank you

@prudhvigodithi prudhvigodithi removed the untriaged Issues that have not yet been triaged label Jun 6, 2024
@rishabh6788
Copy link
Collaborator

In case you are building your own image using OS image as base image, can you please add the instructions on how you are building cuda enabled image?

@rishabh6788
Copy link
Collaborator

@stevapple any update on this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New Enhancement
Projects
Status: Backlog
Development

No branches or pull requests

3 participants