Running on pi - can't get dependencies to work

[peteh]

Did anybody manage to run this on a raspberry pi on bullseye raspbian?

When I try to install the dependencies it fails at tiktoken.
First it failed because no rust compiler is available.

I installed rustc but now it compains that my cargo version is too old.

#0 13.54 Collecting tiktoken
#0 13.57   Downloading tiktoken-0.2.0.tar.gz (21 kB)
#0 13.65   Installing build dependencies: started
#0 22.24   Installing build dependencies: finished with status 'done'
#0 22.25   Getting requirements to build wheel: started
#0 23.62   Getting requirements to build wheel: finished with status 'done'
#0 23.63   Preparing metadata (pyproject.toml): started
#0 24.66   Preparing metadata (pyproject.toml): finished with status 'done'
#0 24.84 Collecting asyncio
#0 24.88   Downloading asyncio-3.4.3-py3-none-any.whl (101 kB)
#0 24.93      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 101.8/101.8 kB 3.4 MB/s eta 0:00:00
#0 25.16 Collecting requests
#0 25.19   Downloading requests-2.28.2-py3-none-any.whl (62 kB)
#0 25.31      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.8/62.8 kB 539.6 kB/s eta 0:00:00
#0 25.49 Collecting tls-client
#0 25.53   Downloading tls_client-0.1.8-py3-none-any.whl (34.9 MB)
#0 57.33      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 34.9/34.9 MB 778.0 kB/s eta 0:00:00
#0 57.90 Collecting httpcore<0.17.0,>=0.15.0
#0 57.94   Downloading httpcore-0.16.3-py3-none-any.whl (69 kB)
#0 58.01      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 69.6/69.6 kB 1.2 MB/s eta 0:00:00
#0 58.11 Collecting rfc3986[idna2008]<2,>=1.3
#0 58.14   Downloading rfc3986-1.5.0-py2.py3-none-any.whl (31 kB)
#0 58.30 Collecting sniffio
#0 58.35   Downloading sniffio-1.3.0-py3-none-any.whl (10 kB)
#0 58.53 Collecting certifi
#0 58.60   Downloading certifi-2022.12.7-py3-none-any.whl (155 kB)
#0 58.79      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.3/155.3 kB 863.4 kB/s eta 0:00:00
#0 58.87 Collecting socksio==1.*
#0 58.91   Downloading socksio-1.0.0-py3-none-any.whl (12 kB)
#0 59.20 Collecting urllib3<1.27,>=1.21.1
#0 59.30   Downloading urllib3-1.26.14-py2.py3-none-any.whl (140 kB)
#0 59.49      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 140.6/140.6 kB 804.3 kB/s eta 0:00:00
#0 59.59 Collecting idna<4,>=2.5
#0 59.63   Downloading idna-3.4-py3-none-any.whl (61 kB)
#0 59.72      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.5/61.5 kB 652.2 kB/s eta 0:00:00
#0 60.12 Collecting charset-normalizer<4,>=2
#0 60.17   Downloading charset_normalizer-3.0.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (195 kB)
#0 60.40      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 195.2/195.2 kB 912.8 kB/s eta 0:00:00
#0 62.71 Collecting regex>=2022.1.18
#0 62.77   Downloading regex-2022.10.31-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (769 kB)
#0 63.94      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 769.8/769.8 kB 665.0 kB/s eta 0:00:00
#0 64.18 Collecting blobfile>=2
#0 64.24   Downloading blobfile-2.0.1-py3-none-any.whl (73 kB)
#0 64.33      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 73.5/73.5 kB 901.0 kB/s eta 0:00:00
#0 64.49 Collecting filelock~=3.0
#0 64.53   Downloading filelock-3.9.0-py3-none-any.whl (9.7 kB)
#0 65.66 Collecting lxml~=4.9
#0 65.72   Downloading lxml-4.9.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.manylinux_2_24_aarch64.whl (6.8 MB)
#0 74.73      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.8/6.8 MB 752.3 kB/s eta 0:00:00
#0 75.55 Collecting pycryptodomex~=3.8
#0 75.59   Downloading pycryptodomex-3.17-cp35-abi3-manylinux2014_aarch64.whl (2.1 MB)
#0 78.01      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 MB 865.4 kB/s eta 0:00:00
#0 78.26 Collecting anyio<5.0,>=3.0
#0 78.31   Downloading anyio-3.6.2-py3-none-any.whl (80 kB)
#0 78.41      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 80.6/80.6 kB 858.2 kB/s eta 0:00:00
#0 78.52 Collecting h11<0.15,>=0.13
#0 78.56   Downloading h11-0.14.0-py3-none-any.whl (58 kB)
#0 78.63      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 1.5 MB/s eta 0:00:00
#0 79.00 Building wheels for collected packages: tiktoken
#0 79.00   Building wheel for tiktoken (pyproject.toml): started
#0 80.44   Building wheel for tiktoken (pyproject.toml): finished with status 'error'
#0 80.47   error: subprocess-exited-with-error
#0 80.47   
#0 80.47   × Building wheel for tiktoken (pyproject.toml) did not run successfully.
#0 80.47   │ exit code: 1
#0 80.47   ╰─> [35 lines of output]
#0 80.47       running bdist_wheel
#0 80.47       running build
#0 80.47       running build_py
#0 80.47       creating build
#0 80.47       creating build/lib.linux-aarch64-cpython-310
#0 80.47       creating build/lib.linux-aarch64-cpython-310/tiktoken
#0 80.47       copying tiktoken/registry.py -> build/lib.linux-aarch64-cpython-310/tiktoken
#0 80.47       copying tiktoken/model.py -> build/lib.linux-aarch64-cpython-310/tiktoken
#0 80.47       copying tiktoken/__init__.py -> build/lib.linux-aarch64-cpython-310/tiktoken
#0 80.47       copying tiktoken/core.py -> build/lib.linux-aarch64-cpython-310/tiktoken
#0 80.47       copying tiktoken/load.py -> build/lib.linux-aarch64-cpython-310/tiktoken
#0 80.47       creating build/lib.linux-aarch64-cpython-310/tiktoken_ext
#0 80.47       copying tiktoken_ext/openai_public.py -> build/lib.linux-aarch64-cpython-310/tiktoken_ext
#0 80.47       running egg_info
#0 80.47       writing tiktoken.egg-info/PKG-INFO
#0 80.47       writing dependency_links to tiktoken.egg-info/dependency_links.txt
#0 80.47       writing requirements to tiktoken.egg-info/requires.txt
#0 80.47       writing top-level names to tiktoken.egg-info/top_level.txt
#0 80.47       reading manifest file 'tiktoken.egg-info/SOURCES.txt'
#0 80.47       reading manifest template 'MANIFEST.in'
#0 80.47       warning: no files found matching 'Makefile'
#0 80.47       adding license file 'LICENSE'
#0 80.47       writing manifest file 'tiktoken.egg-info/SOURCES.txt'
#0 80.47       copying tiktoken/py.typed -> build/lib.linux-aarch64-cpython-310/tiktoken
#0 80.47       running build_ext
#0 80.47       running build_rust
#0 80.47       cargo rustc --lib --message-format=json-render-diagnostics --manifest-path Cargo.toml --release -v --features pyo3/extension-module -- --crate-type cdylib
#0 80.47       error: failed to parse manifest at `/tmp/pip-install-lr044p6g/tiktoken_5cc0479ff6574b8d8cd70e4e86cd797a/Cargo.toml`
#0 80.47       
#0 80.47       Caused by:
#0 80.47         failed to parse the `edition` key
#0 80.47       
#0 80.47       Caused by:
#0 80.47         this version of Cargo is older than the `2021` edition, and only supports `2015` and `2018` editions.
#0 80.47       error: `cargo rustc --lib --message-format=json-render-diagnostics --manifest-path Cargo.toml --release -v --features pyo3/extension-module -- --crate-type cdylib` failed with code 101
#0 80.47       [end of output]
#0 80.47   
#0 80.47   note: This error originates from a subprocess, and is likely not a problem with pip.
#0 80.47   ERROR: Failed building wheel for tiktoken
#0 80.47 Failed to build tiktoken
#0 80.47 ERROR: Could not build wheels for tiktoken, which is required to install pyproject.toml-based projects
#0 80.57 
#0 80.57 [notice] A new release of pip available: 22.3.1 -> 23.0
#0 80.57 [notice] To update, run: pip install --upgrade pip
------
failed to solve: process "/bin/sh -c pip3 install -U -r requirements.txt" did not complete successfully: exit code: 1

Any ideas how to resolve this?

[acheong08]

You need to install rust

[peteh]

I did as stated in my post.
However apt-get install rustc is installing an old rust compiler that is too old for building tiktoken.

I managed to install it using https://rustup.rs/ which installed a recent version. With this I managed to build tiktoken on raspbian and in a docker container.

Thx, issue can be seen as resolved.

[Gauss-G]

Hello, I met the same issue, and can't solve it with your solution to add rust, I don't know if you can give me some suggestions, appreciate it ~

# syntax=docker/dockerfile:1.4
FROM --platform=$TARGETPLATFORM python:3.10-alpine AS builder
# RUN apk add --no-cache rust
RUN apk add curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh

WORKDIR /code
COPY requirements.txt /code
# RUN pip3 install -i https://pypi.tuna.tsinghua.edu.cn/simple/ -U pip 
# RUN pip3 config set global.index-url https://pypi.tuna.tsinghua.edu.cn/simple/
# RUN apt-get install rustc
# RUN sudo apk add curl
# RUN curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | bash -s -- -y

RUN pip3 install -r requirements.txt
...

then still got the error: can't find the rust compiler

Building wheel for cffi (setup.py): started
#0 65.13   Building wheel for cffi (setup.py): finished with status 'error'
#0 65.14   error: subprocess-exited-with-error
#0 65.14   
#0 65.14   × python setup.py bdist_wheel did not run successfully.
#0 65.14   │ exit code: 1
#0 65.14   ╰─> [47 lines of output]
#0 65.14       
#0 65.14           No working compiler found, or bogus compiler options passed to
#0 65.14           the compiler from Python's standard "distutils" module.  See
#0 65.14           the error messages above.  Likely, the problem is not related
#0 65.14           to CFFI but generic to the setup.py of any Python package that
#0 65.14           tries to compile C code.  (Hints: on OS/X 10.8, for errors about
#0 65.14           -mno-fused-madd see http://stackoverflow.com/questions/22313407/
#0 65.14           Otherwise, see https://wiki.python.org/moin/CompLangPython or
#0 65.14           the IRC channel #python on irc.libera.chat.)
#0 65.14       
#0 65.14           Trying to continue anyway.  If you are trying to install CFFI from
#0 65.14           a build done in a different context, you can ignore this warning.
#0 65.14       
#0 65.14       /usr/local/lib/python3.10/site-packages/setuptools/config/setupcfg.py:508: SetuptoolsDeprecationWarning: The license_file parameter is deprecated, use license_files instead.
#0 65.14         warnings.warn(msg, warning_class)
#0 65.14       running bdist_wheel
#0 65.14       running build
#0 65.14       running build_py
#0 65.14       creating build
#0 65.14       creating build/lib.linux-aarch64-cpython-310
#0 65.14       creating build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       copying cffi/recompiler.py -> build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       copying cffi/cffi_opcode.py -> build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       copying cffi/model.py -> build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       copying cffi/ffiplatform.py -> build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       copying cffi/__init__.py -> build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       copying cffi/vengine_cpy.py -> build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       copying cffi/vengine_gen.py -> build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       copying cffi/pkgconfig.py -> build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       copying cffi/verifier.py -> build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       copying cffi/commontypes.py -> build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       copying cffi/error.py -> build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       copying cffi/api.py -> build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       copying cffi/lock.py -> build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       copying cffi/setuptools_ext.py -> build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       copying cffi/backend_ctypes.py -> build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       copying cffi/cparser.py -> build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       copying cffi/_cffi_include.h -> build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       copying cffi/parse_c_type.h -> build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       copying cffi/_embedding.h -> build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       copying cffi/_cffi_errors.h -> build/lib.linux-aarch64-cpython-310/cffi
#0 65.14       running build_ext
#0 65.14       building '_cffi_backend' extension
#0 65.14       creating build/temp.linux-aarch64-cpython-310
#0 65.14       creating build/temp.linux-aarch64-cpython-310/c
#0 65.14       gcc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -fPIC -DFFI_BUILDING=1 -I/usr/include/ffi -I/usr/include/libffi -I/usr/local/include/python3.10 -c c/_cffi_backend.c -o build/temp.linux-aarch64-cpython-310/c/_cffi_backend.o
#0 65.14       error: command 'gcc' failed: No such file or directory
#0 65.14       [end of output]
#0 65.14   
#0 65.14   note: This error originates from a subprocess, and is likely not a problem with pip.
#0 65.14   ERROR: Failed building wheel for cffi
#0 65.14   Running setup.py clean for cffi
#0 65.27   Building wheel for tiktoken (pyproject.toml): started
#0 65.39   Building wheel for tiktoken (pyproject.toml): finished with status 'error'
#0 65.39   error: subprocess-exited-with-error
#0 65.39   
#0 65.39   × Building wheel for tiktoken (pyproject.toml) did not run successfully.
#0 65.39   │ exit code: 1
#0 65.39   ╰─> [37 lines of output]
#0 65.39       running bdist_wheel
#0 65.39       running build
#0 65.39       running build_py
#0 65.39       creating build
#0 65.39       creating build/lib.linux-aarch64-cpython-310
#0 65.39       creating build/lib.linux-aarch64-cpython-310/tiktoken
#0 65.39       copying tiktoken/load.py -> build/lib.linux-aarch64-cpython-310/tiktoken
#0 65.39       copying tiktoken/model.py -> build/lib.linux-aarch64-cpython-310/tiktoken
#0 65.39       copying tiktoken/__init__.py -> build/lib.linux-aarch64-cpython-310/tiktoken
#0 65.39       copying tiktoken/core.py -> build/lib.linux-aarch64-cpython-310/tiktoken
#0 65.39       copying tiktoken/registry.py -> build/lib.linux-aarch64-cpython-310/tiktoken
#0 65.39       creating build/lib.linux-aarch64-cpython-310/tiktoken_ext
#0 65.39       copying tiktoken_ext/openai_public.py -> build/lib.linux-aarch64-cpython-310/tiktoken_ext
#0 65.39       running egg_info
#0 65.39       writing tiktoken.egg-info/PKG-INFO
#0 65.39       writing dependency_links to tiktoken.egg-info/dependency_links.txt
#0 65.39       writing requirements to tiktoken.egg-info/requires.txt
#0 65.39       writing top-level names to tiktoken.egg-info/top_level.txt
#0 65.39       reading manifest file 'tiktoken.egg-info/SOURCES.txt'
#0 65.39       reading manifest template 'MANIFEST.in'
#0 65.39       warning: no files found matching 'Makefile'
#0 65.39       adding license file 'LICENSE'
#0 65.39       writing manifest file 'tiktoken.egg-info/SOURCES.txt'
#0 65.39       copying tiktoken/py.typed -> build/lib.linux-aarch64-cpython-310/tiktoken
#0 65.39       running build_ext
#0 65.39       running build_rust
#0 65.39       error: can't find Rust compiler
#0 65.39       
#0 65.39       If you are using an outdated pip version, it is possible a prebuilt wheel is available for this package but pip is not able to install from it. Installing from the wheel would avoid the need for a Rust compiler.
#0 65.39       
#0 65.39       To update pip, run:
#0 65.39       
#0 65.39           pip install --upgrade pip
#0 65.39       
#0 65.39       and then retry package installation.
#0 65.39       
#0 65.39       If you did intend to build this package from source, try installing a Rust compiler from your system package manager and ensure it is on the PATH during installation. Alternatively, rustup (available at https://rustup.rs) is the recommended way to download and update the Rust compiler toolchain.
#0 65.39       [end of output]
#0 65.39   
#0 65.39   note: This error originates from a subprocess, and is likely not a problem with pip.
#0 65.39   ERROR: Failed building wheel for tiktoken
#0 65.39 Successfully built mysql-connector
#0 65.39 Failed to build cffi tiktoken
#0 65.39 ERROR: Could not build wheels for tiktoken, which is required to install pyproject.toml-based projects
#0 65.40 
#0 65.40 [notice] A new release of pip available: 22.3.1 -> 23.0.1
#0 65.40 [notice] To update, run: pip install --upgrade pip
------
failed to solve: executor failed running [/bin/sh -c pip3 install -r requirements.txt]: exit code: 1

[acheong08]

I see you're using apt-get rustc. Your distro might be outdated. Use rustup.rs and install the latest version

[Gauss-G]

thanks very much for you reply, and I am totally new for the docker,
I tried to use the command @peteh share
I commented the first line and try to use the second one, is that the correct one I should use?
`

RUN apk add --no-cache rust

RUN apk add curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh
`
I am not sure if it's the

[peteh]

Hi,

Check my docker file here: https://github.com/peteh/chatgpt-webapi
I'm also using the rustup solution but you need to add the -y parameter for non interactive.

I'm not sure if it's the right way and I should probably also use a docker builder instead of putting it into the main image but it works.