Skip to content

Unpin CUDA 12.* minor version #618

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 4 commits into from
Aug 1, 2025
Merged

Unpin CUDA 12.* minor version #618

merged 4 commits into from
Aug 1, 2025

Conversation

@weiji14
Copy link
Member

@weiji14 weiji14 commented Jul 31, 2025 •
edited
Loading

Package build strings are no longer cuda120*, but cuda12* (cuda126, cuda129, etc). This should eventually unblock the ml-notebook conda-lock issue we've been seeing on #615, etc. Plus we'll get newer versions of pytorch 2.7.1, torchvision 0.22.0, etc.

Note: tensorflow version remains at 2.17.0.

Pin was originally set in #514 🙈

@weiji14
Unpin CUDA 12.* minor version
2ced114 
Package build strings are no longer cuda120*, but cuda12*
@github-actions
Copy link
Contributor

github-actions bot commented Jul 31, 2025

Binder 👈 Try on Mybinder.org!

@pangeo-bot
Copy link
Collaborator

pangeo-bot commented Jul 31, 2025

/condalock
Automatically locking new conda environment, building, and testing images...

@weiji14
Copy link
Member Author

weiji14 commented Jul 31, 2025 

├─ jaxlib >=0.6.2 cuda12* is installable and it requires
│  └─ libabseil >=20250127.1,<20250128.0a0 , which can be installed;
└─ tensorflow >=2.18.0 cuda12* is not installable because it requires
   └─ tensorflow-base [2.18.0 cuda126py310h37489de_200|2.18.0 cuda126py310h8ef36bb_250|...|2.18.0 cuda126py39h7b6b450_200], which requires
      └─ libabseil >=20240722.0,<20240723.0a0 , which conflicts with any installable versions previously reported.

@weiji14
Pin jaxlib to >=0.5.0
451c297 
Fix libabseil compatibility, as tensorflow 2.18.0 requires `libabseil >=20240722.0,<20240723.0a0`.
@weiji14
Copy link
Member Author

weiji14 commented Jul 31, 2025

/condalock

@weiji14
Copy link
Member Author

weiji14 commented Jul 31, 2025 •
edited
Loading

Great, another incompatibility. Why is dask-ml in pangeo-notebook and not ml-notebook 😂

The following packages are incompatible
├─ dask-ml is installable with the potential options
│  ├─ dask-ml [0.3.1|0.3.2|...|0.8.0] would require
│  │  └─ python_abi * *_cp27mu, which can be installed;
│  ├─ dask-ml [0.3.1|0.3.2|...|0.8.0] would require
│  │  └─ python_abi * *_cp35m, which can be installed;
│  ├─ dask-ml [0.3.1|0.3.2|...|0.8.0] would require
│  │  └─ python_abi * *_cp36m, which can be installed;
│  ├─ dask-ml [0.10.0|0.11.0|...|2021.10.17] would require
│  │  └─ numba with the potential options
│  │     ├─ numba [0.36.1|0.38.0|0.38.1] would require
│  │     │  └─ numpy >=1.11,<1.21.0a0 , which can be installed;
│  │     ├─ numba 0.36.2 would require
│  │     │  └─ numpy <1.21.0a0 , which can be installed;
│  │     ├─ numba [0.40.0|0.40.1|0.41.0|0.43.1] would require
│  │     │  └─ numpy >=1.9.3,<1.21.0a0 , which can be installed;
│  │     ├─ numba [0.42.1|0.43.0|0.43.1] would require
│  │     │  └─ numpy >=1.15.4,<1.21.0a0 , which can be installed;
│  │     ├─ numba [0.44.1|0.45.0|...|0.50.1] would require
│  │     │  └─ numpy >=1.14.6,<1.21.0a0 , which can be installed;
│  │     ├─ numba [0.49.0|0.49.1] would require
│  │     │  └─ numpy >=1.14.6,<1.18.0 , which can be installed;
│  │     ├─ numba [0.51.0|0.51.1|0.51.2|0.52.0] would require
│  │     │  └─ numpy >=1.16.5,<1.21.0a0 , which can be installed;
│  │     ├─ numba 0.53.0 would require
│  │     │  └─ numpy >=1.16.6,<1.21.0a0 , which can be installed;
│  │     ├─ numba [0.53.0|0.53.1] would require
│  │     │  └─ numpy >=1.19.5,<1.21.0a0 , which can be installed;
│  │     ├─ numba 0.53.1 would require
│  │     │  └─ numpy >=1.17.5,<1.21.0a0 , which can be installed;
│  │     ├─ numba [0.54.0|0.54.1] would require
│  │     │  └─ numpy >=1.17,<1.21 , which can be installed;
│  │     ├─ numba [0.55.0|0.55.1] would require
│  │     │  └─ numpy >=1.18,<1.22 , which can be installed;
│  │     ├─ numba 0.55.2 would require
│  │     │  └─ numpy >=1.18,<1.23 , which can be installed;
│  │     ├─ numba [0.56.2|0.56.3|0.56.4] would require
│  │     │  └─ numpy >=1.18,!=1.22.0,!=1.22.1,!=1.22.2,<1.24 , which can be installed;
│  │     ├─ numba [0.57.0|0.57.1] would require
│  │     │  └─ numpy >=1.21,!=1.22.0,!=1.22.1,!=1.22.2,<1.25 , which can be installed;
│  │     ├─ numba [0.58.1|0.59.0|0.59.1] would require
│  │     │  └─ numpy >=1.22.3,<1.27 , which can be installed;
│  │     ├─ numba 0.60.0 would require
│  │     │  └─ numpy >=1.22.3,<2.1 , which can be installed;
│  │     ├─ numba 0.61.0 would require
│  │     │  └─ numpy >=1.24,<2.2  with the potential options
│  │     │     ├─ numpy [2.1.1|2.1.2|2.1.3] conflicts with any installable versions previously reported;
│  │     │     ├─ numpy [2.1.1|2.1.2|...|2.2.6] would require
│  │     │     │  └─ python >=3.12,<3.13.0a0 , which requires
│  │     │     │     └─ python_abi 3.12.* *_cp312, which can be installed;
│  │     │     ├─ numpy [1.24.0|1.24.1|...|1.25.2], which can be installed;
│  │     │     ├─ numpy 1.26.0, which can be installed;
│  │     │     ├─ numpy 1.26.2, which can be installed;
│  │     │     ├─ numpy 1.26.3, which can be installed;
│  │     │     ├─ numpy 1.26.4, which can be installed;
│  │     │     ├─ numpy [2.0.0|2.0.1|2.0.2], which can be installed;
│  │     │     └─ numpy 2.1.0, which can be installed;
│  │     └─ numba 0.61.2 would require
│  │        └─ numpy [>=1.24,<2.3 |>=1.24,<2.3.0a0 ] with the potential options
│  │           ├─ numpy [2.1.1|2.1.2|2.1.3] conflicts with any installable versions previously reported;
│  │           ├─ numpy [2.1.1|2.1.2|...|2.2.6], which cannot be installed (as previously explained);
│  │           ├─ numpy [2.2.0|2.2.1|...|2.2.6] conflicts with any installable versions previously reported;
│  │           ├─ numpy 2.2.6 would require
│  │           │  └─ python_abi 3.11.* *_cp311, which conflicts with any installable versions previously reported;
│  │           ├─ numpy 2.2.6 would require
│  │           │  └─ python_abi 3.13.* *_cp313, which conflicts with any installable versions previously reported;
│  │           ├─ numpy [1.24.0|1.24.1|...|1.25.2], which can be installed;
│  │           ├─ numpy 1.26.0, which can be installed;
│  │           ├─ numpy 1.26.2, which can be installed;
│  │           ├─ numpy 1.26.3, which can be installed;
│  │           ├─ numpy 1.26.4, which can be installed;
│  │           ├─ numpy [2.0.0|2.0.1|2.0.2], which can be installed;
│  │           └─ numpy 2.1.0, which can be installed;
│  └─ dask-ml [2021.11.16|2021.11.30|...|2025.1.0] would require
│     └─ numba >=0.51.0 , which can be installed (as previously explained);
├─ flax >=0.8.0  is installable and it requires
│  └─ tensorstore with the potential options
│     ├─ tensorstore [0.1.44|0.1.46|...|0.1.51] would require
│     │  ├─ libprotobuf [>=4.24.3,<4.24.4.0a0 |>=4.24.4,<4.24.5.0a0 |>=4.25.1,<4.25.2.0a0 ], which requires
│     │  │  └─ libabseil >=20230802.1,<20230803.0a0 , which can be installed;
│     │  └─ numpy >=1.22.4,<2.0a0 , which can be installed;
│     ├─ tensorstore 0.1.44 would require
│     │  ├─ libjpeg-turbo >=2.1.5.1,<3.0a0 , which can be installed;
│     │  ├─ numpy >=1.22.4,<2.0a0 , which can be installed;
│     │  └─ python_abi 3.10.* *_cp310, which conflicts with any installable versions previously reported;
│     ├─ tensorstore [0.1.44|0.1.46|...|0.1.51] would require
│     │  ├─ libprotobuf [>=4.24.3,<4.24.4.0a0 |>=4.24.4,<4.24.5.0a0 |>=4.25.1,<4.25.2.0a0 ], which can be installed (as previously explained);
│     │  └─ numpy >=1.23.5,<2.0a0 , which can be installed;
│     ├─ tensorstore 0.1.44 would require
│     │  ├─ libjpeg-turbo >=2.1.5.1,<3.0a0 , which can be installed;
│     │  ├─ numpy >=1.23.5,<2.0a0 , which can be installed;
│     │  └─ python_abi 3.11.* *_cp311, which conflicts with any installable versions previously reported;
│     ├─ tensorstore 0.1.44 would require
│     │  ├─ libjpeg-turbo >=2.1.5.1,<3.0a0 , which can be installed;
│     │  ├─ libprotobuf >=4.23.4,<4.23.5.0a0  with the potential options
│     │  │  ├─ libprotobuf 4.23.4 would require
│     │  │  │  └─ libabseil >=20230125.3,<20230126.0a0 , which can be installed;
│     │  │  └─ libprotobuf 4.23.4 would require
│     │  │     └─ libabseil >=20230802.0,<20230803.0a0 , which can be installed;
│     │  └─ numpy >=1.26.0,<2.0a0 , which can be installed;
│     ├─ tensorstore [0.1.44|0.1.46|...|0.1.50] would require
│     │  ├─ libprotobuf [>=4.24.3,<4.24.4.0a0 |>=4.24.4,<4.24.5.0a0 ], which can be installed (as previously explained);
│     │  └─ numpy >=1.26.0,<2.0a0 , which can be installed;
│     ├─ tensorstore 0.1.44 would require
│     │  ├─ libjpeg-turbo >=2.1.5.1,<3.0a0 , which can be installed;
│     │  ├─ numpy >=1.22.4,<2.0a0 , which can be installed;
│     │  └─ python_abi 3.8.* *_cp38, which conflicts with any installable versions previously reported;
│     ├─ tensorstore 0.1.44 would require
│     │  ├─ libjpeg-turbo >=2.1.5.1,<3.0a0 , which can be installed;
│     │  ├─ numpy >=1.22.4,<2.0a0 , which can be installed;
│     │  └─ python_abi 3.9.* *_cp39, which conflicts with any installable versions previously reported;
│     ├─ tensorstore [0.1.51|0.1.54] would require
│     │  ├─ libprotobuf >=4.25.2,<4.25.3.0a0  with the potential options
│     │  │  ├─ libprotobuf [4.25.2|4.25.3] would require
│     │  │  │  └─ libabseil >=20240116.1,<20240117.0a0 , which can be installed;
│     │  │  └─ libprotobuf 4.25.2 would require
│     │  │     └─ libabseil >=20240116.0,<20240117.0a0 , which can be installed;
│     │  ├─ numpy >=1.22.4,<2.0a0 , which can be installed;
│     │  └─ python_abi 3.10.* *_cp310, which conflicts with any installable versions previously reported;
│     ├─ tensorstore [0.1.51|0.1.54] would require
│     │  ├─ libprotobuf >=4.25.2,<4.25.3.0a0 , which can be installed (as previously explained);
│     │  ├─ numpy >=1.23.5,<2.0a0 , which can be installed;
│     │  └─ python_abi 3.11.* *_cp311, which conflicts with any installable versions previously reported;
│     ├─ tensorstore 0.1.51 would require
│     │  ├─ libprotobuf >=4.24.4,<4.24.5.0a0 , which can be installed (as previously explained);
│     │  └─ numpy >=1.26.2,<2.0a0 , which can be installed;
│     ├─ tensorstore [0.1.51|0.1.54] would require
│     │  ├─ libprotobuf >=4.25.2,<4.25.3.0a0 , which can be installed (as previously explained);
│     │  └─ numpy >=1.26.4,<2.0a0 , which can be installed;
│     ├─ tensorstore 0.1.51 would require
│     │  ├─ libprotobuf >=4.25.1,<4.25.2.0a0 , which can be installed (as previously explained);
│     │  └─ numpy >=1.26.3,<2.0a0 , which can be installed;
│     ├─ tensorstore [0.1.51|0.1.54] would require
│     │  ├─ libprotobuf >=4.25.2,<4.25.3.0a0 , which can be installed (as previously explained);
│     │  ├─ numpy >=1.22.4,<2.0a0 , which can be installed;
│     │  └─ python_abi 3.9.* *_cp39, which conflicts with any installable versions previously reported;
│     ├─ tensorstore [0.1.54|0.1.55|...|0.1.65] would require
│     │  ├─ libprotobuf >=4.25.3,<4.25.4.0a0  with the potential options
│     │  │  ├─ libprotobuf [4.25.2|4.25.3], which can be installed (as previously explained);
│     │  │  └─ libprotobuf 4.25.3 would require
│     │  │     └─ libabseil >=20240116.2,<20240117.0a0 , which can be installed;
│     │  ├─ numpy >=1.22.4,<2.0a0 , which can be installed;
│     │  └─ python_abi 3.10.* *_cp310, which conflicts with any installable versions previously reported;
│     ├─ tensorstore [0.1.54|0.1.55|...|0.1.65] would require
│     │  ├─ libprotobuf >=4.25.3,<4.25.4.0a0 , which can be installed (as previously explained);
│     │  ├─ numpy >=1.23.5,<2.0a0 , which can be installed;
│     │  └─ python_abi 3.11.* *_cp311, which conflicts with any installable versions previously reported;
│     ├─ tensorstore [0.1.54|0.1.55|...|0.1.65] would require
│     │  ├─ libprotobuf >=4.25.3,<4.25.4.0a0 , which can be installed (as previously explained);
│     │  └─ numpy >=1.26.4,<2.0a0 , which can be installed;
│     ├─ tensorstore [0.1.54|0.1.55|...|0.1.65] would require
│     │  ├─ libprotobuf >=4.25.3,<4.25.4.0a0 , which can be installed (as previously explained);
│     │  ├─ numpy >=1.22.4,<2.0a0 , which can be installed;
│     │  └─ python_abi 3.9.* *_cp39, which conflicts with any installable versions previously reported;
│     ├─ tensorstore [0.1.62|0.1.65] would require
│     │  ├─ libprotobuf >=4.25.3,<4.25.4.0a0 , which can be installed (as previously explained);
│     │  ├─ numpy >=2.1.1,<3.0a0  but there are no viable options
│     │  │  ├─ numpy [2.1.1|2.1.2|2.1.3] conflicts with any installable versions previously reported;
│     │  │  ├─ numpy [2.1.1|2.1.2|...|2.2.6], which cannot be installed (as previously explained);
│     │  │  ├─ numpy [2.2.0|2.2.1|...|2.2.6] conflicts with any installable versions previously reported;
│     │  │  ├─ numpy 2.2.6, which cannot be installed (as previously explained);
│     │  │  ├─ numpy 2.2.6, which cannot be installed (as previously explained);
│     │  │  └─ numpy [2.3.0|2.3.1|2.3.2] conflicts with any installable versions previously reported;
│     │  └─ python_abi 3.13.* *_cp313, which conflicts with any installable versions previously reported;
│     ├─ tensorstore 0.1.65 would require
│     │  └─ libprotobuf >=5.28.2,<5.28.3.0a0 , which can be installed;
│     └─ tensorstore 0.1.65 would require
│        └─ libprotobuf >=5.29.3,<5.29.4.0a0  with the potential options
│           ├─ libprotobuf 5.29.3 would require
│           │  └─ libabseil >=20250127.0,<20250128.0a0 , which can be installed;
│           └─ libprotobuf 5.29.3 would require
│              └─ libabseil >=20250127.1,<20250128.0a0 , which can be installed;
├─ jaxlib >=0.5.0 cuda12* is installable with the potential options
│  ├─ jaxlib [0.5.0|0.5.1|0.5.2] would require
│  │  ├─ libabseil >=20240722.0,<20240723.0a0 , which conflicts with any installable versions previously reported;
│  │  └─ python >=3.12,<3.13.0a0 , which can be installed (as previously explained);
│  ├─ jaxlib [0.5.0|0.5.1|0.5.2] would require
│  │  └─ python_abi 3.10.* *_cp310, which conflicts with any installable versions previously reported;
│  ├─ jaxlib [0.5.0|0.5.1|0.5.2] would require
│  │  └─ python_abi 3.11.* *_cp311, which conflicts with any installable versions previously reported;
│  ├─ jaxlib [0.5.0|0.5.1|0.5.2] would require
│  │  └─ python_abi 3.13.* *_cp313, which conflicts with any installable versions previously reported;
│  ├─ jaxlib 0.5.2 would require
│  │  └─ libabseil >=20250127.0,<20250128.0a0 , which can be installed;
│  └─ jaxlib [0.5.2|0.5.3|0.6.0|0.6.2|0.7.0] would require
│     └─ libabseil >=20250127.1,<20250128.0a0 , which can be installed;
├─ python 3.12** , which can be installed (as previously explained);
└─ tensorflow >=2.18.0 cuda12* is not installable because there are no viable options
   ├─ tensorflow 2.18.0 would require
   │  ├─ tensorflow-base [2.18.0 cuda126py310h37489de_200|2.18.0 cuda126py310h8ef36bb_250], which requires
   │  │  └─ libabseil >=20240722.0,<20240723.0a0 , which conflicts with any installable versions previously reported;
   │  └─ tensorflow-estimator [2.18.0 cuda126py310h3fb4243_250|2.18.0 cuda126py310h85e22ce_200], which requires
   │     └─ python_abi 3.10.* *_cp310, which conflicts with any installable versions previously reported;
   ├─ tensorflow 2.18.0 would require
   │  ├─ tensorflow-base [2.18.0 cuda126py311h4bc60a2_250|2.18.0 cuda126py311h593f62b_200], which cannot be installed (as previously explained);
   │  └─ tensorflow-estimator [2.18.0 cuda126py311h3eb005d_200|2.18.0 cuda126py311hcf67771_250], which requires
   │     └─ python_abi 3.11.* *_cp311, which conflicts with any installable versions previously reported;
   ├─ tensorflow 2.18.0 would require
   │  ├─ python >=3.12,<3.13.0a0 , which can be installed (as previously explained);
   │  ├─ python_abi 3.12.* *_cp312, which conflicts with any installable versions previously reported;
   │  ├─ tensorflow-base 2.18.0 cuda126py312hfb0ba9c_200, which requires
   │  │  ├─ libabseil >=20240722.0,<20240723.0a0 , which conflicts with any installable versions previously reported;
   │  │  └─ libprotobuf >=5.28.3,<5.28.4.0a0 , which conflicts with any installable versions previously reported;
   │  └─ tensorflow-estimator 2.18.0 cuda126py312hd49ae37_200, which requires
   │     └─ python >=3.12,<3.13.0a0 , which can be installed (as previously explained);
   ├─ tensorflow 2.18.0 would require
   │  ├─ python_abi 3.12.* *_cp312, which conflicts with any installable versions previously reported;
   │  ├─ tensorflow-base 2.18.0 cuda126py312h4e605f9_250, which requires
   │  │  ├─ libabseil >=20240722.0,<20240723.0a0 , which conflicts with any installable versions previously reported;
   │  │  ├─ libjpeg-turbo >=3.1.0,<4.0a0 , which conflicts with any installable versions previously reported;
   │  │  └─ libprotobuf >=5.28.3,<5.28.4.0a0 , which conflicts with any installable versions previously reported;
   │  └─ tensorflow-estimator 2.18.0 cuda126py312haa5479e_250, which can be installed (as previously explained);
   └─ tensorflow 2.18.0 would require
      ├─ tensorflow-base [2.18.0 cuda126py39h65081ab_250|2.18.0 cuda126py39h7b6b450_200], which cannot be installed (as previously explained);
      └─ tensorflow-estimator [2.18.0 cuda126py39h7914130_250|2.18.0 cuda126py39h88c3955_200], which requires
         └─ python_abi 3.9.* *_cp39, which conflicts with any installable versions previously reported.

Maybe waiting for conda-forge/tensorflow-feedstock#433 isn't a bad idea...

@weiji14
Copy link
Member Author

weiji14 commented Jul 31, 2025

/condalock

@weiji14 weiji14 marked this pull request as ready for review August 1, 2025 00:29
@scottyhq scottyhq mentioned this pull request Aug 1, 2025
Open
scottyhq
scottyhq approved these changes Aug 1, 2025
View reviewed changes
Copy link
Member

@scottyhq scottyhq left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for moving things forward @weiji14 !

@scottyhq scottyhq merged commit 6f6de68 into master Aug 1, 2025
5 checks passed
@scottyhq scottyhq deleted the unpin_cuda12_minor branch August 1, 2025 16:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@scottyhq scottyhq scottyhq approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@weiji14 @pangeo-bot @scottyhq