Issue with building project environment #1
Description
Firstly, congratulations on putting this work out!
I was looking to try reproducing some of your experiments, but ran into this issue whilst running the commands to reproduce your python environment (installation commands from the readme):
~/wafer/ml-clara git @ [main] ... - conda create -n clara python=3.10 -y && conda activate clara
2 channel Terms of Service accepted
Channels:
- defaults
Platform: linux-64
Collecting package metadata (repodata.json): done
Solving environment: done
==> WARNING: A newer version of conda exists. <==
current version: 25.7.0
latest version: 25.11.1
Please update conda by running
$ conda update -n base -c defaults conda
## Package Plan ##
environment location: /opt/miniconda/clara
added / updated specs:
- python=3.10
The following NEW packages will be INSTALLED:
_libgcc_mutex pkgs/main/linux-64::_libgcc_mutex-0.1-main
_openmp_mutex pkgs/main/linux-64::_openmp_mutex-5.1-1_gnu
bzip2 pkgs/main/linux-64::bzip2-1.0.8-h5eee18b_6
ca-certificates pkgs/main/linux-64::ca-certificates-2025.12.2-h06a4308_0
expat pkgs/main/linux-64::expat-2.7.3-h7354ed3_4
ld_impl_linux-64 pkgs/main/linux-64::ld_impl_linux-64-2.44-h153f514_2
libexpat pkgs/main/linux-64::libexpat-2.7.3-h7354ed3_4
libffi pkgs/main/linux-64::libffi-3.4.4-h6a678d5_1
libgcc pkgs/main/linux-64::libgcc-15.2.0-h69a1729_7
libgcc-ng pkgs/main/linux-64::libgcc-ng-15.2.0-h166f726_7
libgomp pkgs/main/linux-64::libgomp-15.2.0-h4751f2c_7
libnsl pkgs/main/linux-64::libnsl-2.0.0-h5eee18b_0
libstdcxx pkgs/main/linux-64::libstdcxx-15.2.0-h39759b7_7
libstdcxx-ng pkgs/main/linux-64::libstdcxx-ng-15.2.0-hc03a8fd_7
libuuid pkgs/main/linux-64::libuuid-1.41.5-h5eee18b_0
libxcb pkgs/main/linux-64::libxcb-1.17.0-h9b100fa_0
libzlib pkgs/main/linux-64::libzlib-1.3.1-hb25bd0a_0
ncurses pkgs/main/linux-64::ncurses-6.5-h7934f7d_0
openssl pkgs/main/linux-64::openssl-3.0.18-hd6dcaed_0
pip pkgs/main/noarch::pip-25.3-pyhc872135_0
pthread-stubs pkgs/main/linux-64::pthread-stubs-0.3-h0ce48e5_1
python pkgs/main/linux-64::python-3.10.19-h6fa692b_0
readline pkgs/main/linux-64::readline-8.3-hc2a1206_0
setuptools pkgs/main/linux-64::setuptools-80.9.0-py310h06a4308_0
sqlite pkgs/main/linux-64::sqlite-3.51.0-h2a70700_0
tk pkgs/main/linux-64::tk-8.6.15-h54e0aa7_0
tzdata pkgs/main/noarch::tzdata-2025b-h04d1e81_0
wheel pkgs/main/linux-64::wheel-0.45.1-py310h06a4308_0
xorg-libx11 pkgs/main/linux-64::xorg-libx11-1.8.12-h9b100fa_1
xorg-libxau pkgs/main/linux-64::xorg-libxau-1.0.12-h9b100fa_0
xorg-libxdmcp pkgs/main/linux-64::xorg-libxdmcp-1.1.5-h9b100fa_0
xorg-xorgproto pkgs/main/linux-64::xorg-xorgproto-2024.1-h5eee18b_1
xz pkgs/main/linux-64::xz-5.6.4-h5eee18b_1
zlib pkgs/main/linux-64::zlib-1.3.1-hb25bd0a_0
Downloading and Extracting Packages:
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
#
# To activate this environment, use
#
# $ conda activate clara
#
# To deactivate an active environment, use
#
# $ conda deactivate
(clara) ~/wafer/ml-clara git @ [main] ... + pip install -r requirements.txt
Collecting accelerate==1.10.1 (from -r requirements.txt (line 1))
Using cached accelerate-1.10.1-py3-none-any.whl.metadata (19 kB)
Collecting aiohappyeyeballs==2.6.1 (from -r requirements.txt (line 2))
Using cached aiohappyeyeballs-2.6.1-py3-none-any.whl.metadata (5.9 kB)
Collecting aiohttp==3.12.15 (from -r requirements.txt (line 3))
Using cached aiohttp-3.12.15-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (7.7 kB)
Collecting aiosignal==1.4.0 (from -r requirements.txt (line 4))
Using cached aiosignal-1.4.0-py3-none-any.whl.metadata (3.7 kB)
Collecting airportsdata==20250909 (from -r requirements.txt (line 5))
Using cached airportsdata-20250909-py3-none-any.whl.metadata (9.2 kB)
Collecting annotated-types==0.7.0 (from -r requirements.txt (line 6))
Using cached annotated_types-0.7.0-py3-none-any.whl.metadata (15 kB)
Collecting anthropic==0.37.1 (from -r requirements.txt (line 7))
Using cached anthropic-0.37.1-py3-none-any.whl.metadata (21 kB)
Collecting anyio==4.11.0 (from -r requirements.txt (line 8))
Using cached anyio-4.11.0-py3-none-any.whl.metadata (4.1 kB)
Collecting astor==0.8.1 (from -r requirements.txt (line 9))
Using cached astor-0.8.1-py2.py3-none-any.whl.metadata (4.2 kB)
Collecting async-timeout==5.0.1 (from -r requirements.txt (line 10))
Using cached async_timeout-5.0.1-py3-none-any.whl.metadata (5.1 kB)
Collecting attrs==25.3.0 (from -r requirements.txt (line 11))
Using cached attrs-25.3.0-py3-none-any.whl.metadata (10 kB)
Collecting blake3==1.0.7 (from -r requirements.txt (line 12))
Using cached blake3-1.0.7-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (217 bytes)
Collecting cachetools==6.2.0 (from -r requirements.txt (line 13))
Using cached cachetools-6.2.0-py3-none-any.whl.metadata (5.4 kB)
Collecting cbor2==5.7.0 (from -r requirements.txt (line 14))
Using cached cbor2-5.7.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (5.4 kB)
Collecting certifi==2025.8.3 (from -r requirements.txt (line 15))
Using cached certifi-2025.8.3-py3-none-any.whl.metadata (2.4 kB)
Collecting cffi==2.0.0 (from -r requirements.txt (line 16))
Using cached cffi-2.0.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (2.6 kB)
Collecting charset-normalizer==3.4.3 (from -r requirements.txt (line 17))
Using cached charset_normalizer-3.4.3-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (36 kB)
Collecting click==8.3.0 (from -r requirements.txt (line 18))
Using cached click-8.3.0-py3-none-any.whl.metadata (2.6 kB)
Collecting cloudpickle==3.1.1 (from -r requirements.txt (line 19))
Using cached cloudpickle-3.1.1-py3-none-any.whl.metadata (7.1 kB)
Collecting cohere==5.14.0 (from -r requirements.txt (line 20))
Using cached cohere-5.14.0-py3-none-any.whl.metadata (3.4 kB)
Collecting coloredlogs==15.0.1 (from -r requirements.txt (line 21))
Using cached coloredlogs-15.0.1-py2.py3-none-any.whl.metadata (12 kB)
Collecting compressed-tensors==0.9.2 (from -r requirements.txt (line 22))
Using cached compressed_tensors-0.9.2-py3-none-any.whl.metadata (7.0 kB)
Collecting cupy-cuda12x==13.6.0 (from -r requirements.txt (line 23))
Using cached cupy_cuda12x-13.6.0-cp310-cp310-manylinux2014_x86_64.whl.metadata (2.4 kB)
Collecting dacite==1.8.1 (from -r requirements.txt (line 24))
Using cached dacite-1.8.1-py3-none-any.whl.metadata (15 kB)
Collecting dataclasses-json==0.6.7 (from -r requirements.txt (line 25))
Using cached dataclasses_json-0.6.7-py3-none-any.whl.metadata (25 kB)
Collecting datasets==3.2.0 (from -r requirements.txt (line 26))
Using cached datasets-3.2.0-py3-none-any.whl.metadata (20 kB)
Collecting deepspeed==0.18.1 (from -r requirements.txt (line 27))
Using cached deepspeed-0.18.1.tar.gz (1.6 MB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Collecting depyf==0.18.0 (from -r requirements.txt (line 28))
Using cached depyf-0.18.0-py3-none-any.whl.metadata (7.1 kB)
Collecting dill==0.3.8 (from -r requirements.txt (line 29))
Using cached dill-0.3.8-py3-none-any.whl.metadata (10 kB)
Collecting diskcache==5.6.3 (from -r requirements.txt (line 30))
Using cached diskcache-5.6.3-py3-none-any.whl.metadata (20 kB)
Collecting distro==1.9.0 (from -r requirements.txt (line 31))
Using cached distro-1.9.0-py3-none-any.whl.metadata (6.8 kB)
Collecting dnspython==2.8.0 (from -r requirements.txt (line 32))
Using cached dnspython-2.8.0-py3-none-any.whl.metadata (5.7 kB)
Collecting einops==0.8.1 (from -r requirements.txt (line 33))
Using cached einops-0.8.1-py3-none-any.whl.metadata (13 kB)
Collecting email-validator==2.3.0 (from -r requirements.txt (line 34))
Using cached email_validator-2.3.0-py3-none-any.whl.metadata (26 kB)
Collecting eval_type_backport==0.2.2 (from -r requirements.txt (line 35))
Using cached eval_type_backport-0.2.2-py3-none-any.whl.metadata (2.2 kB)
Collecting fastapi==0.118.0 (from -r requirements.txt (line 36))
Using cached fastapi-0.118.0-py3-none-any.whl.metadata (28 kB)
Collecting fastapi-cli==0.0.13 (from -r requirements.txt (line 37))
Using cached fastapi_cli-0.0.13-py3-none-any.whl.metadata (6.3 kB)
Collecting fastapi-cloud-cli==0.2.1 (from -r requirements.txt (line 38))
Using cached fastapi_cloud_cli-0.2.1-py3-none-any.whl.metadata (3.2 kB)
Collecting fastavro==1.12.0 (from -r requirements.txt (line 39))
Using cached fastavro-1.12.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (5.7 kB)
Collecting fastrlock==0.8.3 (from -r requirements.txt (line 40))
Using cached fastrlock-0.8.3-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_28_x86_64.whl.metadata (7.7 kB)
Collecting filelock==3.19.1 (from -r requirements.txt (line 41))
Using cached filelock-3.19.1-py3-none-any.whl.metadata (2.1 kB)
Collecting flatbuffers==25.9.23 (from -r requirements.txt (line 42))
Using cached flatbuffers-25.9.23-py2.py3-none-any.whl.metadata (875 bytes)
Collecting frozendict==2.4.6 (from -r requirements.txt (line 43))
Using cached frozendict-2.4.6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (23 kB)
Collecting frozenlist==1.7.0 (from -r requirements.txt (line 44))
Using cached frozenlist-1.7.0-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (18 kB)
Collecting fschat==0.2.36 (from -r requirements.txt (line 45))
Using cached fschat-0.2.36-py3-none-any.whl.metadata (20 kB)
Collecting fsspec==2024.9.0 (from -r requirements.txt (line 46))
Using cached fsspec-2024.9.0-py3-none-any.whl.metadata (11 kB)
Collecting ftfy==6.3.1 (from -r requirements.txt (line 47))
Using cached ftfy-6.3.1-py3-none-any.whl.metadata (7.3 kB)
Collecting gguf==0.10.0 (from -r requirements.txt (line 48))
Using cached gguf-0.10.0-py3-none-any.whl.metadata (3.5 kB)
Collecting gitdb==4.0.12 (from -r requirements.txt (line 49))
Using cached gitdb-4.0.12-py3-none-any.whl.metadata (1.2 kB)
Collecting GitPython==3.1.45 (from -r requirements.txt (line 50))
Using cached gitpython-3.1.45-py3-none-any.whl.metadata (13 kB)
Collecting h11==0.16.0 (from -r requirements.txt (line 51))
Using cached h11-0.16.0-py3-none-any.whl.metadata (8.3 kB)
Collecting hf-xet==1.1.10 (from -r requirements.txt (line 52))
Using cached hf_xet-1.1.10-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.7 kB)
Collecting hjson==3.1.0 (from -r requirements.txt (line 53))
Using cached hjson-3.1.0-py3-none-any.whl.metadata (2.6 kB)
Collecting httpcore==1.0.9 (from -r requirements.txt (line 54))
Using cached httpcore-1.0.9-py3-none-any.whl.metadata (21 kB)
Collecting httptools==0.6.4 (from -r requirements.txt (line 55))
Using cached httptools-0.6.4-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.6 kB)
Collecting httpx==0.27.2 (from -r requirements.txt (line 56))
Using cached httpx-0.27.2-py3-none-any.whl.metadata (7.1 kB)
Collecting httpx-sse==0.4.0 (from -r requirements.txt (line 57))
Using cached httpx_sse-0.4.0-py3-none-any.whl.metadata (9.0 kB)
Collecting huggingface-hub==0.35.3 (from -r requirements.txt (line 58))
Using cached huggingface_hub-0.35.3-py3-none-any.whl.metadata (14 kB)
Collecting humanfriendly==10.0 (from -r requirements.txt (line 59))
Using cached humanfriendly-10.0-py2.py3-none-any.whl.metadata (9.2 kB)
Collecting idna==3.10 (from -r requirements.txt (line 60))
Using cached idna-3.10-py3-none-any.whl.metadata (10 kB)
Collecting interegular==0.3.3 (from -r requirements.txt (line 61))
Using cached interegular-0.3.3-py37-none-any.whl.metadata (3.0 kB)
Collecting Jinja2==3.1.6 (from -r requirements.txt (line 62))
Using cached jinja2-3.1.6-py3-none-any.whl.metadata (2.9 kB)
Collecting jiter==0.11.0 (from -r requirements.txt (line 63))
Using cached jiter-0.11.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.2 kB)
Collecting joblib==1.5.2 (from -r requirements.txt (line 64))
Using cached joblib-1.5.2-py3-none-any.whl.metadata (5.6 kB)
Collecting jsonschema==4.25.1 (from -r requirements.txt (line 65))
Using cached jsonschema-4.25.1-py3-none-any.whl.metadata (7.6 kB)
Collecting jsonschema-specifications==2025.9.1 (from -r requirements.txt (line 66))
Using cached jsonschema_specifications-2025.9.1-py3-none-any.whl.metadata (2.9 kB)
Collecting lark==1.2.2 (from -r requirements.txt (line 67))
Using cached lark-1.2.2-py3-none-any.whl.metadata (1.8 kB)
Collecting latex2mathml==3.78.1 (from -r requirements.txt (line 68))
Using cached latex2mathml-3.78.1-py3-none-any.whl.metadata (15 kB)
Collecting litellm==1.56.2 (from -r requirements.txt (line 69))
Using cached litellm-1.56.2-py3-none-any.whl.metadata (36 kB)
Collecting llama_cpp_python==0.2.76 (from -r requirements.txt (line 70))
Using cached llama_cpp_python-0.2.76.tar.gz (49.4 MB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Installing backend dependencies ... done
Preparing metadata (pyproject.toml) ... done
Collecting llguidance==0.7.30 (from -r requirements.txt (line 71))
Using cached llguidance-0.7.30-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (10 kB)
Collecting llm-blender==0.0.2 (from -r requirements.txt (line 72))
Using cached llm_blender-0.0.2-py3-none-any.whl.metadata (19 kB)
Collecting llmlingua==0.2.2 (from -r requirements.txt (line 73))
Using cached llmlingua-0.2.2-py3-none-any.whl.metadata (17 kB)
Collecting llvmlite==0.43.0 (from -r requirements.txt (line 74))
Using cached llvmlite-0.43.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.8 kB)
Collecting lm-format-enforcer==0.10.12 (from -r requirements.txt (line 75))
Using cached lm_format_enforcer-0.10.12-py3-none-any.whl.metadata (17 kB)
Collecting markdown-it-py==4.0.0 (from -r requirements.txt (line 76))
Using cached markdown_it_py-4.0.0-py3-none-any.whl.metadata (7.3 kB)
Collecting markdown2==2.5.4 (from -r requirements.txt (line 77))
Using cached markdown2-2.5.4-py3-none-any.whl.metadata (2.1 kB)
Collecting MarkupSafe==3.0.3 (from -r requirements.txt (line 78))
Using cached markupsafe-3.0.3-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (2.7 kB)
Collecting marshmallow==3.26.1 (from -r requirements.txt (line 79))
Using cached marshmallow-3.26.1-py3-none-any.whl.metadata (7.3 kB)
Collecting mdurl==0.1.2 (from -r requirements.txt (line 80))
Using cached mdurl-0.1.2-py3-none-any.whl.metadata (1.6 kB)
Collecting mistral_common==1.8.5 (from -r requirements.txt (line 81))
Using cached mistral_common-1.8.5-py3-none-any.whl.metadata (5.1 kB)
Collecting mpmath==1.3.0 (from -r requirements.txt (line 82))
Using cached mpmath-1.3.0-py3-none-any.whl.metadata (8.6 kB)
Collecting msgpack==1.1.1 (from -r requirements.txt (line 83))
Using cached msgpack-1.1.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (8.4 kB)
Collecting msgspec==0.19.0 (from -r requirements.txt (line 84))
Using cached msgspec-0.19.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.9 kB)
Collecting multidict==6.6.4 (from -r requirements.txt (line 85))
Using cached multidict-6.6.4-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (5.3 kB)
Collecting multiprocess==0.70.16 (from -r requirements.txt (line 86))
Using cached multiprocess-0.70.16-py310-none-any.whl.metadata (7.2 kB)
Collecting mypy_extensions==1.1.0 (from -r requirements.txt (line 87))
Using cached mypy_extensions-1.1.0-py3-none-any.whl.metadata (1.1 kB)
Collecting networkx==3.4.2 (from -r requirements.txt (line 88))
Using cached networkx-3.4.2-py3-none-any.whl.metadata (6.3 kB)
Collecting nh3==0.3.0 (from -r requirements.txt (line 89))
Using cached nh3-0.3.0-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.0 kB)
Collecting ninja==1.13.0 (from -r requirements.txt (line 90))
Using cached ninja-1.13.0-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (5.1 kB)
Collecting nltk==3.9.2 (from -r requirements.txt (line 91))
Using cached nltk-3.9.2-py3-none-any.whl.metadata (3.2 kB)
Collecting numba==0.60.0 (from -r requirements.txt (line 92))
Using cached numba-0.60.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (2.7 kB)
Collecting numpy==1.26.4 (from -r requirements.txt (line 93))
Using cached numpy-1.26.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (61 kB)
Collecting nvidia-cublas-cu11==11.11.3.6 (from -r requirements.txt (line 94))
Using cached nvidia_cublas_cu11-11.11.3.6-py3-none-manylinux2014_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-cublas-cu12==12.6.4.1 (from -r requirements.txt (line 95))
Using cached nvidia_cublas_cu12-12.6.4.1-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-cuda-cupti-cu11==11.8.87 (from -r requirements.txt (line 96))
Using cached nvidia_cuda_cupti_cu11-11.8.87-py3-none-manylinux2014_x86_64.whl.metadata (1.6 kB)
Collecting nvidia-cuda-cupti-cu12==12.6.80 (from -r requirements.txt (line 97))
Using cached nvidia_cuda_cupti_cu12-12.6.80-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.6 kB)
Collecting nvidia-cuda-nvrtc-cu11==11.8.89 (from -r requirements.txt (line 98))
Using cached nvidia_cuda_nvrtc_cu11-11.8.89-py3-none-manylinux2014_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-cuda-nvrtc-cu12==12.6.77 (from -r requirements.txt (line 99))
Using cached nvidia_cuda_nvrtc_cu12-12.6.77-py3-none-manylinux2014_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-cuda-runtime-cu11==11.8.89 (from -r requirements.txt (line 100))
Using cached nvidia_cuda_runtime_cu11-11.8.89-py3-none-manylinux2014_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-cuda-runtime-cu12==12.6.77 (from -r requirements.txt (line 101))
Using cached nvidia_cuda_runtime_cu12-12.6.77-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-cudnn-cu11==9.1.0.70 (from -r requirements.txt (line 102))
Using cached nvidia_cudnn_cu11-9.1.0.70-py3-none-manylinux2014_x86_64.whl.metadata (1.6 kB)
Collecting nvidia-cudnn-cu12==9.5.1.17 (from -r requirements.txt (line 103))
Using cached nvidia_cudnn_cu12-9.5.1.17-py3-none-manylinux_2_28_x86_64.whl.metadata (1.6 kB)
Collecting nvidia-cufft-cu11==10.9.0.58 (from -r requirements.txt (line 104))
Using cached nvidia_cufft_cu11-10.9.0.58-py3-none-manylinux2014_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-cufft-cu12==11.3.0.4 (from -r requirements.txt (line 105))
Using cached nvidia_cufft_cu12-11.3.0.4-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-cufile-cu12==1.11.1.6 (from -r requirements.txt (line 106))
Using cached nvidia_cufile_cu12-1.11.1.6-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-curand-cu11==10.3.0.86 (from -r requirements.txt (line 107))
Using cached nvidia_curand_cu11-10.3.0.86-py3-none-manylinux2014_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-curand-cu12==10.3.7.77 (from -r requirements.txt (line 108))
Using cached nvidia_curand_cu12-10.3.7.77-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-cusolver-cu11==11.4.1.48 (from -r requirements.txt (line 109))
Using cached nvidia_cusolver_cu11-11.4.1.48-py3-none-manylinux2014_x86_64.whl.metadata (1.6 kB)
Collecting nvidia-cusolver-cu12==11.7.1.2 (from -r requirements.txt (line 110))
Using cached nvidia_cusolver_cu12-11.7.1.2-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.6 kB)
Collecting nvidia-cusparse-cu11==11.7.5.86 (from -r requirements.txt (line 111))
Using cached nvidia_cusparse_cu11-11.7.5.86-py3-none-manylinux2014_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-cusparse-cu12==12.5.4.2 (from -r requirements.txt (line 112))
Using cached nvidia_cusparse_cu12-12.5.4.2-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.6 kB)
Collecting nvidia-cusparselt-cu12==0.6.3 (from -r requirements.txt (line 113))
Using cached nvidia_cusparselt_cu12-0.6.3-py3-none-manylinux2014_x86_64.whl.metadata (6.8 kB)
Collecting nvidia-ml-py==13.580.82 (from -r requirements.txt (line 114))
Using cached nvidia_ml_py-13.580.82-py3-none-any.whl.metadata (9.6 kB)
Collecting nvidia-nccl-cu11==2.21.5 (from -r requirements.txt (line 115))
Using cached nvidia_nccl_cu11-2.21.5-py3-none-manylinux2014_x86_64.whl.metadata (1.8 kB)
Collecting nvidia-nccl-cu12==2.26.2 (from -r requirements.txt (line 116))
Using cached nvidia_nccl_cu12-2.26.2-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (2.0 kB)
Collecting nvidia-nvjitlink-cu12==12.6.85 (from -r requirements.txt (line 117))
Using cached nvidia_nvjitlink_cu12-12.6.85-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-nvtx-cu11==11.8.86 (from -r requirements.txt (line 118))
Using cached nvidia_nvtx_cu11-11.8.86-py3-none-manylinux2014_x86_64.whl.metadata (1.7 kB)
Collecting nvidia-nvtx-cu12==12.6.77 (from -r requirements.txt (line 119))
Using cached nvidia_nvtx_cu12-12.6.77-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.6 kB)
Collecting onnxruntime==1.19.2 (from -r requirements.txt (line 120))
Using cached onnxruntime-1.19.2-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (4.5 kB)
Collecting openai==1.52.2 (from -r requirements.txt (line 121))
Using cached openai-1.52.2-py3-none-any.whl.metadata (24 kB)
Collecting openai-harmony==0.0.4 (from -r requirements.txt (line 122))
Using cached openai_harmony-0.0.4-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (8.0 kB)
Collecting opencv-python-headless==4.11.0.86 (from -r requirements.txt (line 123))
Using cached opencv_python_headless-4.11.0.86-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (20 kB)
Collecting outlines==0.1.11 (from -r requirements.txt (line 124))
Using cached outlines-0.1.11-py3-none-any.whl.metadata (17 kB)
Collecting outlines_core==0.1.26 (from -r requirements.txt (line 125))
Using cached outlines_core-0.1.26-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.8 kB)
Collecting pandas==2.2.3 (from -r requirements.txt (line 126))
Using cached pandas-2.2.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (89 kB)
Collecting partial-json-parser==0.2.1.1.post6 (from -r requirements.txt (line 127))
Using cached partial_json_parser-0.2.1.1.post6-py3-none-any.whl.metadata (6.1 kB)
Collecting peft==0.17.1 (from -r requirements.txt (line 128))
Using cached peft-0.17.1-py3-none-any.whl.metadata (14 kB)
Collecting pillow==10.4.0 (from -r requirements.txt (line 129))
Using cached pillow-10.4.0-cp310-cp310-manylinux_2_28_x86_64.whl.metadata (9.2 kB)
Collecting prettytable==3.11.0 (from -r requirements.txt (line 130))
Using cached prettytable-3.11.0-py3-none-any.whl.metadata (30 kB)
Collecting prometheus-fastapi-instrumentator==7.1.0 (from -r requirements.txt (line 131))
Using cached prometheus_fastapi_instrumentator-7.1.0-py3-none-any.whl.metadata (13 kB)
Collecting prometheus_client==0.23.1 (from -r requirements.txt (line 132))
Using cached prometheus_client-0.23.1-py3-none-any.whl.metadata (1.9 kB)
Collecting propcache==0.3.2 (from -r requirements.txt (line 133))
Using cached propcache-0.3.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (12 kB)
Collecting protobuf==6.32.1 (from -r requirements.txt (line 134))
Using cached protobuf-6.32.1-cp39-abi3-manylinux2014_x86_64.whl.metadata (593 bytes)
Collecting py-cpuinfo==9.0.0 (from -r requirements.txt (line 135))
Using cached py_cpuinfo-9.0.0-py3-none-any.whl.metadata (794 bytes)
Collecting pyarrow==21.0.0 (from -r requirements.txt (line 136))
Using cached pyarrow-21.0.0-cp310-cp310-manylinux_2_28_x86_64.whl.metadata (3.3 kB)
Collecting pybase64==1.4.2 (from -r requirements.txt (line 137))
Using cached pybase64-1.4.2-cp310-cp310-manylinux1_x86_64.manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_5_x86_64.whl.metadata (8.7 kB)
Collecting pycountry==24.6.1 (from -r requirements.txt (line 138))
Using cached pycountry-24.6.1-py3-none-any.whl.metadata (12 kB)
Collecting pycparser==2.23 (from -r requirements.txt (line 139))
Using cached pycparser-2.23-py3-none-any.whl.metadata (993 bytes)
Collecting pydantic==2.11.9 (from -r requirements.txt (line 140))
Using cached pydantic-2.11.9-py3-none-any.whl.metadata (68 kB)
Collecting pydantic-extra-types==2.10.5 (from -r requirements.txt (line 141))
Using cached pydantic_extra_types-2.10.5-py3-none-any.whl.metadata (3.9 kB)
Collecting pydantic_core==2.33.2 (from -r requirements.txt (line 142))
Using cached pydantic_core-2.33.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.8 kB)
Collecting python-dotenv==1.1.1 (from -r requirements.txt (line 143))
Using cached python_dotenv-1.1.1-py3-none-any.whl.metadata (24 kB)
Collecting python-json-logger==3.3.0 (from -r requirements.txt (line 144))
Using cached python_json_logger-3.3.0-py3-none-any.whl.metadata (4.0 kB)
Collecting python-multipart==0.0.20 (from -r requirements.txt (line 145))
Using cached python_multipart-0.0.20-py3-none-any.whl.metadata (1.8 kB)
ERROR: Ignored the following versions that require a different python version: 0.36.0 Requires-Python >=3.6,<3.10; 0.37.0 Requires-Python >=3.7,<3.10; 0.52.0 Requires-Python >=3.6,<3.9; 0.52.0rc3 Requires-Python >=3.6,<3.9; 0.53.0 Requires-Python >=3.6,<3.10; 0.53.0rc1.post1 Requires-Python >=3.6,<3.10; 0.53.0rc2 Requires-Python >=3.6,<3.10; 0.53.0rc3 Requires-Python >=3.6,<3.10; 0.53.1 Requires-Python >=3.6,<3.10; 0.54.0 Requires-Python >=3.7,<3.10; 0.54.0rc2 Requires-Python >=3.7,<3.10; 0.54.0rc3 Requires-Python >=3.7,<3.10; 0.54.1 Requires-Python >=3.7,<3.10; 2.3.0 Requires-Python >=3.11; 2.3.1 Requires-Python >=3.11; 2.3.2 Requires-Python >=3.11; 2.3.3 Requires-Python >=3.11; 2.3.4 Requires-Python >=3.11; 2.3.5 Requires-Python >=3.11; 2.4.0rc1 Requires-Python >=3.11; 3.0.0rc0 Requires-Python >=3.11; 3.5 Requires-Python >=3.11; 3.5rc0 Requires-Python >=3.11; 3.6 Requires-Python >=3.11; 3.6.1 Requires-Python >=3.11,!=3.14.1; 3.6rc0 Requires-Python >=3.11
ERROR: Could not find a version that satisfies the requirement pytorch-triton-rocm==3.2.0 (from versions: 0.0.1, 0.0.2, 2.0.0.dev20230209, 2.0.0.dev20230210, 2.0.0.dev20230211, 2.0.0.dev20230218, 2.0.0.dev20230227, 2.0.0.dev20230228, 2.0.0.dev20230307, 2.0.0.dev20230308, 2.0.0, 2.0.1, 2.0.2.dev20230401, 2.0.2.dev20230402, 2.0.2, 2.1.0.dev20230402, 2.1.0)ERROR: No matching distribution found for pytorch-triton-rocm==3.2.0
And CUDA version:
nvcc -V
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2025 NVIDIA Corporation
Built on Wed_Jan_15_19:20:09_PST_2025
Cuda compilation tools, release 12.8, V12.8.61
Build cuda_12.8.r12.8/compiler.35404655_0
I also noticed that flash-attention (version flash-attn>=2.8.0) is mentioned as being a "key dependency" but don't see it in the requirements.txt.
Is there a different way that you folks recommend building the environment?