No binary wheel for py313 published on pypi

[ssbarnea]

SUMMARY

Latest version of ansible-pylibssh published on pypi is missing py313, for both amd64 and arm64 architectures and this break ability to install any ansible component that is requiring this library, like ansible.netcommon collection on python 3.13

Apparently trying to install from source does create some kind of deadlock on these platforms:

• MacOS
• ubuntu 24.24

These failures can be seen at https://github.com/ansible/ansible-dev-environment/actions/runs/14306408049

I mention that the jobs timeout after ~40 minutes due to GHA default setup.

TRACE Comparing installed with source: Registry(InstalledRegistryDist { name: PackageName("setuptools"), version: "78.1.0", path: "/Users/ssbarnea/.cache/uv/builds-v0/.tmpc8o1Rt/lib/python3.13/site-packages/setuptools-78.1.0.dist-info", cache_info: None }) Registry { specifier: VersionSpecifiers([VersionSpecifier { operator: Equal, version: "78.1.0" }]), index: Some(IndexMetadata { url: Pypi(VerbatimUrl { url: Url { scheme: "https", cannot_be_a_base: false, username: "", password: None, host: Some(Domain("pypi.org")), port: None, path: "/simple", query: None, fragment: None }, given: None }), format: Simple }), conflict: None }
DEBUG Requirement already installed: setuptools==78.1.0
DEBUG Installing build requirement: cython==3.1.0b1
TRACE Extracting file name=PackageName("cython")
TRACE Cloning /Users/ssbarnea/.cache/uv/archive-v0/14SPFoExWhnhqJwWCSInL/cython.py to /Users/ssbarnea/.cache/uv/builds-v0/.tmpc8o1Rt/lib/python3.13/site-packages/cython.py
TRACE Cloning /Users/ssbarnea/.cache/uv/archive-v0/14SPFoExWhnhqJwWCSInL/cython-3.1.0b1.dist-info to /Users/ssbarnea/.cache/uv/builds-v0/.tmpc8o1Rt/lib/python3.13/site-packages/cython-3.1.0b1.dist-info
TRACE Cloning /Users/ssbarnea/.cache/uv/archive-v0/14SPFoExWhnhqJwWCSInL/Cython to /Users/ssbarnea/.cache/uv/builds-v0/.tmpc8o1Rt/lib/python3.13/site-packages/Cython
TRACE Cloning /Users/ssbarnea/.cache/uv/archive-v0/14SPFoExWhnhqJwWCSInL/pyximport to /Users/ssbarnea/.cache/uv/builds-v0/.tmpc8o1Rt/lib/python3.13/site-packages/pyximport
TRACE Extracted 4 files name=PackageName("cython")
TRACE Writing entrypoints name=PackageName("cython")
TRACE No data name=PackageName("cython")
TRACE Writing installer metadata name=PackageName("cython")
TRACE Writing record name=PackageName("cython")
DEBUG Calling `pep517_backend.hooks.build_wheel("/Users/ssbarnea/.cache/uv/builds-v0/.tmpKLgrYK", {}, None)`
DEBUG [1/1] Cythonizing /private/var/folders/32/1xrphgzd4xv777syxjtkpdw80000gn/T/.tmp-ansible-pylibssh-pep517-rtyma534/src/src/pylibsshext/_libssh_version.pyx
DEBUG [1/1] Cythonizing /private/var/folders/32/1xrphgzd4xv777syxjtkpdw80000gn/T/.tmp-ansible-pylibssh-pep517-rtyma534/src/src/pylibsshext/errors.pyx
DEBUG [1/1] Cythonizing /private/var/folders/32/1xrphgzd4xv777syxjtkpdw80000gn/T/.tmp-ansible-pylibssh-pep517-rtyma534/src/src/pylibsshext/sftp.pyx
DEBUG [1/1] Cythonizing /private/var/folders/32/1xrphgzd4xv777syxjtkpdw80000gn/T/.tmp-ansible-pylibssh-pep517-rtyma534/src/src/pylibsshext/session.pyx
DEBUG [1/1] Cythonizing /private/var/folders/32/1xrphgzd4xv777syxjtkpdw80000gn/T/.tmp-ansible-pylibssh-pep517-rtyma534/src/src/pylibsshext/channel.pyx
DEBUG [1/1] Cythonizing /private/var/folders/32/1xrphgzd4xv777syxjtkpdw80000gn/T/.tmp-ansible-pylibssh-pep517-rtyma534/src/src/pylibsshext/scp.pyx
DEBUG clang: error: unknown argument: '-show-sdk-path)/usr/include'
DEBUG clang: error: unknown argument: '-show-sdk-path)/usr/include'
DEBUG clang: error: unknown argument: '-show-sdk-path)/usr/include'
DEBUG clang: error: unknown argument: '-show-sdk-path)/usr/include'
DEBUG clang: error: unknown argument: '-show-sdk-path)/usr/include'
DEBUG error: command '/usr/bin/cc' failed with exit code 1
DEBUG clang: error: unknown argument: '-show-sdk-path)/usr/include'
DEBUG error: command '/usr/bin/cc' failed with exit code 1
DEBUG error: command '/usr/bin/cc' failed with exit code 1
DEBUG error: command '/usr/bin/cc' failed with exit code 1
DEBUG error: command '/usr/bin/cc' failed with exit code 1
DEBUG error: command '/usr/bin/cc' failed with exit code 1

[ssbarnea]

Apparently even trying to build the unreleased code from main branch gives this error:

writing manifest file 'src/ansible_pylibssh.egg-info/SOURCES.txt'
* Installing packages in isolated environment:
  - Cython >= 3.0.0; python_version >= "3.12" and python_version < "3.13"
  - Cython >= 3.0.11; python_version >= "3.13"
  - Cython; python_version < "3.12"
* Building wheel...
[1/1] Cythonizing /private/var/folders/32/1xrphgzd4xv777syxjtkpdw80000gn/T/.tmp-ansible-pylibssh-pep517-kh8rkr62/src/src/pylibsshext/_libssh_version.pyx
clang: error: unknown argument: '-show-sdk-path)/usr/include'
error: command '/usr/bin/cc' failed with exit code 1

ERROR Backend subprocess exited when trying to invoke build_wheel

[ssbarnea]

It should be mentioned that 5 days ago building the wheel worked on GHA on both macos and ubuntu. I suspect something changed since that time that broke it.

[webknjaz]

Python 3.13 was never tested. And the last release was published months ago.
There were a number of packaging problems in the repo. One of which was CI/CD on 3.12+ on macOS and Ubuntu.
Its getting stuck there after seemingly successful builds. @Jakuje suggested that there might be some subprocess hanging around in the step.

I checked that non-x86 containers built when it last worked 2 months ago can no longer build and couldn't figure out why. That's another problem that I can't debug because QEMU isn't working on my machine.

[webknjaz]

The CI job you linked doesn't seem to be failing during install but during testing because there's visible pytest output. If you think, it's during install, you'd need to separate that step clearly.

[sumitguptaibm]

@webknjaz ,
I am looking for a fix of this one, as I plan to change paramiko usage to native ssh in my collection ibm.storage_virtualize.
Is this already fixed and merged?

[webknjaz]

Not yet.

[TiTi]

Still same error here, on my packer pipeline to build ansible agent.
And yeah the ~40min for failure is painful, pipeline appears stuck in "Building wheel for ansible-pylibssh"

Tried to build it but didn't work either (was probably missing a package despsite my tries).

=> Have to stick with python 3.12 rather than 3.13...

[webknjaz]

Yes.

[Riccardo1976]

It would have been nice to know things, instead of just patiently waiting for a timeout, perhaps ansible-pylibssh could give an error.

On the pypi page for ansible-pylibssh is a mention that libssh should have a minimum version of 0.0.9.

I also mentions installing tox.

The machine it is failing on had either no libssh installed or an older version of libssh.

Below works:

python3.13 -m venv venv
source venv/bin/activate
pip install -U pip
pip install tox

sudo emerge -av net-libs/libssh
# Completed (1 of 1) net-libs/libssh-0.11.2::gentoo

pip wheel ./ ansible-pylibssh

(venv) riccardo@usagi ~/Repos/meh $ pip wheel -w ./ ansible-pylibssh
Collecting ansible-pylibssh
  Using cached ansible-pylibssh-1.2.2.tar.gz (135 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
  Preparing metadata (pyproject.toml) ... done
Building wheels for collected packages: ansible-pylibssh
  Building wheel for ansible-pylibssh (pyproject.toml) ... done
  Created wheel for ansible-pylibssh: filename=ansible_pylibssh-1.2.2-cp313-cp313-linux_x86_64.whl size=391533 sha256=7c07c30eda9efd2d1ac82f2537f32de80174cef1a24c2855b16ccbd7eed7525c
  Stored in directory: /home/riccardo/.cache/pip/wheels/cb/8f/3c/19af1af05bcdbbc426a2789890255a3c31a6ccae64b5466b7d
Successfully built ansible-pylibssh

pip install ./ansible_pylibssh-1.2.2-cp313-cp313-linux_x86_64.whl

(venv) riccardo@usagi ~/Repos/meh $ pip freeze
ansible-pylibssh @ file:///home/riccardo/Repos/meh/ansible_pylibssh-1.2.2-cp313-cp313-linux_x86_64.whl#sha256=7c07c30eda9efd2d1ac82f2537f32de80174cef1a24c2855b16ccbd7eed7525c
cachetools==6.1.0
chardet==5.2.0
colorama==0.4.6
distlib==0.4.0
filelock==3.18.0
packaging==25.0
platformdirs==4.3.8
pluggy==1.6.0
pyproject-api==1.9.1
tox==4.28.4
virtualenv==20.33.1

[webknjaz]

@Riccardo1976 we switched to libssh 0.11.x on devel. But PyPI only displays what's in the published dists. Once we release, it'll be updated with the current README. If you see something outdated in the repo/docs, feel free to send a PR.

[restena-sw]

I encountered the same silent hang during "Building wheel ...", but was able to find a root cause, at least for Debian trixie.

The long silent hang follows a compilation issue:

pip wheel -v -w ./ ansible-pylibssh
[...]
src/src/pylibsshext/scp.c:1138:10: fatal error: libssh/libssh.h: No such file or directory

So, my default debian install was simply missing the libssh development package. Installing it with

apt install libssh-dev

solved the issue for me, and ansible-pylibssh compiled all the way through on Python313.

Now guessing that the build issue on Ubuntu might be just the same, with the same simple solution?