Skip to content

Commit

Permalink
Downgrade Ray container image to Python 3.9
Browse files Browse the repository at this point in the history
  • Loading branch information
astefanutti committed Jul 2, 2024
1 parent a06ed81 commit 5dd865d
Show file tree
Hide file tree
Showing 5 changed files with 11 additions and 11 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -69,7 +69,7 @@
" head_memory=128,\n",
" head_gpus=1,\n",
" num_gpus=1,\n",
" image=\"quay.io/rhoai/ray:2.23.0-py311-cu121-torch\",\n",
" image=\"quay.io/rhoai/ray:2.23.0-py39-cu121-torch\",\n",
"))"
]
},
Expand Down
2 changes: 1 addition & 1 deletion examples/ray-finetune-llm-deepspeed/requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ deepspeed==0.14.4
# Flash Attention 2 requires PyTorch to be installed first
# See https://github.com/Dao-AILab/flash-attention/issues/453
#flash-attn==2.5.9.post1
https://github.com/Dao-AILab/flash-attention/releases/download/v2.5.9.post1/flash_attn-2.5.9.post1+cu122torch2.3cxx11abiFALSE-cp311-cp311-linux_x86_64.whl
https://github.com/Dao-AILab/flash-attention/releases/download/v2.5.9.post1/flash_attn-2.5.9.post1+cu122torch2.3cxx11abiFALSE-cp39-cp39-linux_x86_64.whl
peft==0.11.1
ray[train]==2.23.0
torch==2.3.1
Expand Down
2 changes: 1 addition & 1 deletion images/runtime/examples/ray-torch/Dockerfile
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
FROM quay.io/rhoai/ray:2.23.0-py311-cu121
FROM quay.io/rhoai/ray:2.23.0-py39-cu121

RUN python3 -m pip install --no-cache-dir -U pip \
torch==2.3.1
12 changes: 6 additions & 6 deletions images/runtime/ray/Dockerfile
Original file line number Diff line number Diff line change
@@ -1,10 +1,10 @@
FROM registry.access.redhat.com/ubi9/python-311:latest
FROM registry.access.redhat.com/ubi9/python-39:latest

LABEL name="ray-ubi9-py311-cu121" \
summary="CUDA 12.1 Python 3.11 image based on UBI9 for Ray" \
description="CUDA 12.1 Python 3.11 image based on UBI9 for Ray" \
io.k8s.display-name="CUDA 12.1 Python 3.11 base image for Ray" \
io.k8s.description="CUDA 12.1 Python 3.11 image based on UBI9 for Ray" \
LABEL name="ray-ubi9-py39-cu121" \
summary="CUDA 12.1 Python 3.9 image based on UBI9 for Ray" \
description="CUDA 12.1 Python 3.9 image based on UBI9 for Ray" \
io.k8s.display-name="CUDA 12.1 Python 3.9 base image for Ray" \
io.k8s.description="CUDA 12.1 Python 3.9 image based on UBI9 for Ray" \
authoritative-source-url="https://github.com/opendatahub-io/distributed-workloads"

# Install CUDA base from:
Expand Down
4 changes: 2 additions & 2 deletions images/runtime/ray/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
Default base container image for Ray in OpenShift AI.

It includes the following layers:
* UBI9
* Python 3.11
* UBI 9
* Python 3.9
* CUDA 12.1
* Ray 2.23.0

0 comments on commit 5dd865d

Please sign in to comment.