Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP: [Release] Verify release-19.0.1-rc0 #45420

Open
wants to merge 4 commits into
base: maint-19.0.1
Choose a base branch
from
Open

Conversation

kou
Copy link
Member

@kou kou commented Feb 4, 2025

PR to verify Release Candidate

@kou
Copy link
Member Author

kou commented Feb 4, 2025

@github-actions crossbow submit --group verify-rc-source --param release=19.0.1 --param rc=0

Copy link

github-actions bot commented Feb 4, 2025

Revision: 36e0d50

Submitted crossbow builds: ursacomputing/crossbow @ actions-a726d6e4f7

Task Status
verify-rc-source-cpp-linux-almalinux-8-amd64 GitHub Actions
verify-rc-source-cpp-linux-conda-latest-amd64 GitHub Actions
verify-rc-source-cpp-linux-ubuntu-20.04-amd64 GitHub Actions
verify-rc-source-cpp-linux-ubuntu-22.04-amd64 GitHub Actions
verify-rc-source-cpp-macos-amd64 GitHub Actions
verify-rc-source-cpp-macos-arm64 GitHub Actions
verify-rc-source-cpp-macos-conda-amd64 GitHub Actions
verify-rc-source-csharp-linux-almalinux-8-amd64 GitHub Actions
verify-rc-source-csharp-linux-conda-latest-amd64 GitHub Actions
verify-rc-source-csharp-linux-ubuntu-20.04-amd64 GitHub Actions
verify-rc-source-csharp-linux-ubuntu-22.04-amd64 GitHub Actions
verify-rc-source-csharp-macos-amd64 GitHub Actions
verify-rc-source-csharp-macos-arm64 GitHub Actions
verify-rc-source-integration-linux-almalinux-8-amd64 GitHub Actions
verify-rc-source-integration-linux-conda-latest-amd64 GitHub Actions
verify-rc-source-integration-linux-ubuntu-22.04-amd64 GitHub Actions
verify-rc-source-integration-macos-amd64 GitHub Actions
verify-rc-source-integration-macos-arm64 GitHub Actions
verify-rc-source-integration-macos-conda-amd64 GitHub Actions
verify-rc-source-js-linux-almalinux-8-amd64 GitHub Actions
verify-rc-source-js-linux-conda-latest-amd64 GitHub Actions
verify-rc-source-js-linux-ubuntu-20.04-amd64 GitHub Actions
verify-rc-source-js-linux-ubuntu-22.04-amd64 GitHub Actions
verify-rc-source-js-macos-amd64 GitHub Actions
verify-rc-source-js-macos-arm64 GitHub Actions
verify-rc-source-python-linux-almalinux-8-amd64 GitHub Actions
verify-rc-source-python-linux-conda-latest-amd64 GitHub Actions
verify-rc-source-python-linux-ubuntu-22.04-amd64 GitHub Actions
verify-rc-source-python-macos-amd64 GitHub Actions
verify-rc-source-python-macos-arm64 GitHub Actions
verify-rc-source-python-macos-conda-amd64 GitHub Actions
verify-rc-source-ruby-linux-almalinux-8-amd64 GitHub Actions
verify-rc-source-ruby-linux-conda-latest-amd64 GitHub Actions
verify-rc-source-ruby-linux-ubuntu-20.04-amd64 GitHub Actions
verify-rc-source-ruby-linux-ubuntu-22.04-amd64 GitHub Actions
verify-rc-source-ruby-macos-amd64 GitHub Actions
verify-rc-source-ruby-macos-arm64 GitHub Actions
verify-rc-source-windows GitHub Actions

@kou
Copy link
Member Author

kou commented Feb 4, 2025

Revision: apache-arrow-19.0.1-rc0

Submitted crossbow builds: ursacomputing/crossbow @ release-19.0.1-rc0-0

Task Status
almalinux-8-amd64 GitHub Actions
almalinux-8-arm64 GitHub Actions
almalinux-9-amd64 GitHub Actions
almalinux-9-arm64 GitHub Actions
amazon-linux-2023-amd64 GitHub Actions
amazon-linux-2023-arm64 GitHub Actions
centos-7-amd64 GitHub Actions
centos-8-stream-amd64 GitHub Actions
centos-8-stream-arm64 GitHub Actions
centos-9-stream-amd64 GitHub Actions
centos-9-stream-arm64 GitHub Actions
conan-maximum GitHub Actions
conan-minimum GitHub Actions
debian-bookworm-amd64 GitHub Actions
debian-bookworm-arm64 GitHub Actions
debian-trixie-amd64 GitHub Actions
debian-trixie-arm64 GitHub Actions
matlab GitHub Actions
nuget GitHub Actions
python-sdist GitHub Actions
r-binary-packages GitHub Actions
test-debian-12-docs GitHub Actions
ubuntu-focal-amd64 GitHub Actions
ubuntu-focal-arm64 GitHub Actions
ubuntu-jammy-amd64 GitHub Actions
ubuntu-jammy-arm64 GitHub Actions
ubuntu-noble-amd64 GitHub Actions
ubuntu-noble-arm64 GitHub Actions
wheel-macos-monterey-cp310-cp310-amd64 GitHub Actions
wheel-macos-monterey-cp310-cp310-arm64 GitHub Actions
wheel-macos-monterey-cp311-cp311-amd64 GitHub Actions
wheel-macos-monterey-cp311-cp311-arm64 GitHub Actions
wheel-macos-monterey-cp312-cp312-amd64 GitHub Actions
wheel-macos-monterey-cp312-cp312-arm64 GitHub Actions
wheel-macos-monterey-cp313-cp313-amd64 GitHub Actions
wheel-macos-monterey-cp313-cp313-arm64 GitHub Actions
wheel-macos-monterey-cp313-cp313t-amd64 GitHub Actions
wheel-macos-monterey-cp313-cp313t-arm64 GitHub Actions
wheel-macos-monterey-cp39-cp39-amd64 GitHub Actions
wheel-macos-monterey-cp39-cp39-arm64 GitHub Actions
wheel-manylinux-2-28-cp310-cp310-amd64 GitHub Actions
wheel-manylinux-2-28-cp310-cp310-arm64 GitHub Actions
wheel-manylinux-2-28-cp311-cp311-amd64 GitHub Actions
wheel-manylinux-2-28-cp311-cp311-arm64 GitHub Actions
wheel-manylinux-2-28-cp312-cp312-amd64 GitHub Actions
wheel-manylinux-2-28-cp312-cp312-arm64 GitHub Actions
wheel-manylinux-2-28-cp313-cp313-amd64 GitHub Actions
wheel-manylinux-2-28-cp313-cp313-arm64 GitHub Actions
wheel-manylinux-2-28-cp313-cp313t-amd64 GitHub Actions
wheel-manylinux-2-28-cp313-cp313t-arm64 GitHub Actions
wheel-manylinux-2-28-cp39-cp39-amd64 GitHub Actions
wheel-manylinux-2-28-cp39-cp39-arm64 GitHub Actions
wheel-manylinux-2014-cp310-cp310-amd64 GitHub Actions
wheel-manylinux-2014-cp310-cp310-arm64 GitHub Actions
wheel-manylinux-2014-cp311-cp311-amd64 GitHub Actions
wheel-manylinux-2014-cp311-cp311-arm64 GitHub Actions
wheel-manylinux-2014-cp312-cp312-amd64 GitHub Actions
wheel-manylinux-2014-cp312-cp312-arm64 GitHub Actions
wheel-manylinux-2014-cp313-cp313-amd64 GitHub Actions
wheel-manylinux-2014-cp313-cp313-arm64 GitHub Actions
wheel-manylinux-2014-cp313-cp313t-amd64 GitHub Actions
wheel-manylinux-2014-cp313-cp313t-arm64 GitHub Actions
wheel-manylinux-2014-cp39-cp39-amd64 GitHub Actions
wheel-manylinux-2014-cp39-cp39-arm64 GitHub Actions
wheel-windows-cp310-amd64 GitHub Actions
wheel-windows-cp311-amd64 GitHub Actions
wheel-windows-cp312-amd64 GitHub Actions
wheel-windows-cp313-amd64 GitHub Actions
wheel-windows-cp39-amd64 GitHub Actions

@kou
Copy link
Member Author

kou commented Feb 4, 2025

Hmm. wheel-windows-* are still failing...
It seems that it's same as #45295 .

@kou
Copy link
Member Author

kou commented Feb 4, 2025

We may need to backport something for it.

@raulcd
Copy link
Member

raulcd commented Feb 4, 2025

It seems that the nightly wheels are also not working but the jobs are not failing now. For example for the latest nightlies Python tests are not really executed on those jobs! They seem to finish abruptly:

 C:\>mkdir C:\Users\ContainerAdministrator\Downloads\test\tzdata 

C:\>arc unarchive tzdata.tar.xz C:\Users\ContainerAdministrator\Downloads\test\tzdata   || exit /B 
VALUE: &archiver.TarXz{Tar:(*archiver.Tar)(0xc000064720)}
scanning source archive: wrapping reader: xz: file format not recognized

@amoeba
Copy link
Member

amoeba commented Feb 4, 2025

My first thought after some searching around was that IANA may have changed how they issues their TLS cert (which is still possible) and that we just need a newer version of the certifi package but the jobs appear to be pulling in recent ones. I'm seeing if I can reproduce it locally. I wonder if we may just need to update the base image.

@amoeba
Copy link
Member

amoeba commented Feb 4, 2025

I had hoped to reproduce the issue but wasn't able to. I built the image locally,

$ $env:DOCKER_BUILDKIT = 0
archery docker build --no-pull python-wheel-windows-vs2019

and ran this:

$ archery docker run --no-pull -e SETUPTOOLS_SCM_PRETEND_VERSION=20.0.0.dev44 python-wheel-windows-vs2019 cmd
...inside container
C:\>C:\Python39\python.exe
Python 3.9.13 (tags/v3.9.13:6de2ca5, May 17 2022, 16:36:42) [MSC v.1929 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>> from urllib.request import urlopen
>>> import os
>>> tzdata_path = os.path.join(os.getcwd(), "foo")
>>> os.mkdir(tzdata_path)
>>> tzdata_compressed = os.path.join(tzdata_path, "tzdata.tar.gz")
>>>
>>> with urlopen('https://data.iana.org/time-zones/tzdata-latest.tar.gz') as response:
...     with open(tzdata_compressed, 'wb') as f:
...         f.write(response.read())
...
462943

@amoeba
Copy link
Member

amoeba commented Feb 4, 2025

@github-actions crossbow submit wheel-windows-cp39-amd64

Copy link

github-actions bot commented Feb 4, 2025

Revision: 36e0d50

Submitted crossbow builds: ursacomputing/crossbow @ actions-42cab651f2

Task Status
wheel-windows-cp39-amd64 GitHub Actions

@kou
Copy link
Member Author

kou commented Feb 5, 2025

It seems that https://cygwin.osuosl.org/noarch/release/tzdata/tzdata-2024a-1.tar.xz removed.

curl https://cygwin.osuosl.org/noarch/release/tzdata/tzdata-2024a-1.tar.xz --output tzdata.tar.xz || exit /B

We need to use more portable URL.

@amoeba
Copy link
Member

amoeba commented Feb 5, 2025

Thanks @kou. Does it make sense for us to host a copy ourselves?

@kou
Copy link
Member Author

kou commented Feb 5, 2025

Hmm... I think that we don't want to update tzdata periodically...

We may be able to use https://pypi.org/project/tzdata/ .

@amoeba
Copy link
Member

amoeba commented Feb 5, 2025

That seems like it could work,

❯ python -c "import os; from importlib import resources; print(os.path.join(resources.files('tzdata'), 'zoneinfo'));"
C:\Users\Bryce\Temp\tzinfo-testing\venv\Lib\site-packages\tzdata\zoneinfo
❯ dir C:\Users\Bryce\Temp\tzinfo-testing\venv\Lib\site-packages\tzdata\zoneinfo


    Directory: C:\Users\Bryce\Temp\tzinfo-testing\venv\Lib\site-packages\tzdata\zoneinfo
...

@kou
Copy link
Member Author

kou commented Feb 5, 2025

Wow! Could you open a PR that uses https://pypi.org/project/tzdata/ ?

@amoeba
Copy link
Member

amoeba commented Feb 5, 2025

Will do that in a sec once I figure out the .bat script part.

@amoeba
Copy link
Member

amoeba commented Feb 5, 2025

PR over at #45425. I didn't test the whole script since it needs to be tested as part of CI.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants