Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP: Python 3.13 #5

Closed
wants to merge 12 commits into from
Closed

WIP: Python 3.13 #5

wants to merge 12 commits into from

Conversation

zanieb
Copy link
Owner

@zanieb zanieb commented Jun 6, 2024

No description provided.

@zanieb
Copy link
Owner Author

zanieb commented Jun 6, 2024

Windows build fails with

cpython>        "C:\Users\RUNNER~1\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\PCbuild\_decimal.vcxproj" (Build target) (18) ->
cpython>        (ClCompile target) ->
cpython>          c1 : fatal error C1083: Cannot open source file: 'C:\Users\runneradmin\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\externals\mpdecimal-4.0.0\libmpdec\basearith.c': No such file or directory [C:\Users\RUNNER~1\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\PCbuild\_decimal.vcxproj]
cpython>          c1 : fatal error C1083: Cannot open source file: 'C:\Users\runneradmin\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\externals\mpdecimal-4.0.0\libmpdec\constants.c': No such file or directory [C:\Users\RUNNER~1\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\PCbuild\_decimal.vcxproj]
cpython>          c1 : fatal error C1083: Cannot open source file: 'C:\Users\runneradmin\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\externals\mpdecimal-4.0.0\libmpdec\context.c': No such file or directory [C:\Users\RUNNER~1\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\PCbuild\_decimal.vcxproj]
cpython>          c1 : fatal error C1083: Cannot open source file: 'C:\Users\runneradmin\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\externals\mpdecimal-4.0.0\libmpdec\convolute.c': No such file or directory [C:\Users\RUNNER~1\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\PCbuild\_decimal.vcxproj]
cpython>          c1 : fatal error C1083: Cannot open source file: 'C:\Users\runneradmin\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\externals\mpdecimal-4.0.0\libmpdec\crt.c': No such file or directory [C:\Users\RUNNER~1\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\PCbuild\_decimal.vcxproj]
cpython>          c1 : fatal error C1083: Cannot open source file: 'C:\Users\runneradmin\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\externals\mpdecimal-4.0.0\libmpdec\fnt.c': No such file or directory [C:\Users\RUNNER~1\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\PCbuild\_decimal.vcxproj]
cpython>          c1 : fatal error C1083: Cannot open source file: 'C:\Users\runneradmin\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\externals\mpdecimal-4.0.0\libmpdec\difradix2.c': No such file or directory [C:\Users\RUNNER~1\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\PCbuild\_decimal.vcxproj]
cpython>          c1 : fatal error C1083: Cannot open source file: 'C:\Users\runneradmin\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\externals\mpdecimal-4.0.0\libmpdec\fourstep.c': No such file or directory [C:\Users\RUNNER~1\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\PCbuild\_decimal.vcxproj]
cpython>          c1 : fatal error C1083: Cannot open source file: 'C:\Users\runneradmin\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\externals\mpdecimal-4.0.0\libmpdec\io.c': No such file or directory [C:\Users\RUNNER~1\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\PCbuild\_decimal.vcxproj]
cpython>          c1 : fatal error C1083: Cannot open source file: 'C:\Users\runneradmin\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\externals\mpdecimal-4.0.0\libmpdec\mpalloc.c': No such file or directory [C:\Users\RUNNER~1\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\PCbuild\_decimal.vcxproj]
cpython>          c1 : fatal error C1083: Cannot open source file: 'C:\Users\runneradmin\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\externals\mpdecimal-4.0.0\libmpdec\mpdecimal.c': No such file or directory [C:\Users\RUNNER~1\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\PCbuild\_decimal.vcxproj]
cpython>          c1 : fatal error C1083: Cannot open source file: 'C:\Users\runneradmin\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\externals\mpdecimal-4.0.0\libmpdec\numbertheory.c': No such file or directory [C:\Users\RUNNER~1\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\PCbuild\_decimal.vcxproj]
cpython>          c1 : fatal error C1083: Cannot open source file: 'C:\Users\runneradmin\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\externals\mpdecimal-4.0.0\libmpdec\sixstep.c': No such file or directory [C:\Users\RUNNER~1\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\PCbuild\_decimal.vcxproj]
cpython>          c1 : fatal error C1083: Cannot open source file: 'C:\Users\runneradmin\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\externals\mpdecimal-4.0.0\libmpdec\transpose.c': No such file or directory [C:\Users\RUNNER~1\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\PCbuild\_decimal.vcxproj]
cpython>          C:\Users\runneradmin\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\Modules\_decimal\windows\mpdecimal.h(13,14): fatal error C1083: Cannot open include file: 'mpdecimal32vc.h': No such file or directory (compiling source file ..\Modules\_decimal\_decimal.c) [C:\Users\RUNNER~1\AppData\Local\Temp\python-build-2oaq9phw\Python-3.13.0b1\PCbuild\_decimal.vcxproj]

@zanieb

This comment was marked as outdated.

@zanieb

This comment was marked as outdated.

@zanieb
Copy link
Owner Author

zanieb commented Jun 6, 2024

Some build / validation workflows are succeeding now! But there is a failure on the PGO builds:

2024-06-06T14:41:13.8509515Z cpython-3.13> LD_LIBRARY_PATH=/build/Python-3.13.0b1 ./python -m test --pgo --timeout=
2024-06-06T14:41:14.4721772Z cpython-3.13> Using random seed: 3630533237
2024-06-06T14:41:14.4722931Z cpython-3.13> 0:00:00 load avg: 2.53 Run 44 tests sequentially
2024-06-06T14:41:14.4723987Z cpython-3.13> 0:00:00 load avg: 2.53 [ 1/44] test_array
2024-06-06T14:41:15.9231051Z cpython-3.13> 0:00:01 load avg: 2.41 [ 2/44] test_base64
2024-06-06T14:41:18.6740282Z cpython-3.13> 0:00:04 load avg: 2.41 [ 3/44] test_binascii
2024-06-06T14:41:18.7698062Z cpython-3.13> 0:00:04 load avg: 2.41 [ 4/44] test_binop
2024-06-06T14:41:18.8463920Z cpython-3.13> 0:00:04 load avg: 2.41 [ 5/44] test_bisect
2024-06-06T14:41:18.9465060Z cpython-3.13> 0:00:04 load avg: 2.41 [ 6/44] test_bytes
2024-06-06T14:41:19.0936489Z cpython-3.13> 0:00:04 load avg: 2.41 [ 7/44] test_bz2 -- test_bytes skipped
2024-06-06T14:41:22.1080773Z cpython-3.13> 0:00:07 load avg: 2.30 [ 8/44] test_cmath
2024-06-06T14:41:22.2968922Z cpython-3.13> 0:00:07 load avg: 2.30 [ 9/44] test_codecs
2024-06-06T14:41:23.5730666Z cpython-3.13> 0:00:09 load avg: 2.30 [10/44] test_collections
2024-06-06T14:41:24.3534783Z cpython-3.13> 0:00:09 load avg: 2.30 [11/44] test_complex
2024-06-06T14:41:24.6535516Z cpython-3.13> 0:00:10 load avg: 2.30 [12/44] test_dataclasses
2024-06-06T14:41:25.2374900Z cpython-3.13> 0:00:10 load avg: 2.30 [13/44] test_datetime
2024-06-06T14:41:29.2557137Z cpython-3.13> 0:00:14 load avg: 2.19 [14/44] test_decimal
2024-06-06T14:41:32.8490327Z cpython-3.13> 0:00:18 load avg: 2.10 [15/44] test_difflib
2024-06-06T14:41:33.7806220Z cpython-3.13> 0:00:19 load avg: 2.10 [16/44] test_embed
2024-06-06T14:41:45.9800425Z cpython-3.13> Fatal Python error: Segmentation fault
2024-06-06T14:41:45.9801940Z cpython-3.13> 
2024-06-06T14:41:45.9803753Z cpython-3.13> Current thread 0x00007f1ac0fbd740 (most recent call first):
2024-06-06T14:41:45.9805390Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/test/test_embed.py", line 1620 in test_global_pathconfig
2024-06-06T14:41:45.9806989Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/unittest/case.py", line 606 in _callTestMethod
2024-06-06T14:41:45.9808342Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/unittest/case.py", line 651 in run
2024-06-06T14:41:45.9811098Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/unittest/case.py", line 707 in __call__
2024-06-06T14:41:45.9812381Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/unittest/suite.py", line 122 in run
2024-06-06T14:41:45.9813849Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/unittest/suite.py", line 84 in __call__
2024-06-06T14:41:45.9815235Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/unittest/suite.py", line 122 in run
2024-06-06T14:41:45.9816564Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/unittest/suite.py", line 84 in __call__
2024-06-06T14:41:45.9818271Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/test/libregrtest/testresult.py", line 146 in run
2024-06-06T14:41:45.9819125Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/test/libregrtest/single.py", line 57 in
2024-06-06T14:41:45.9819693Z cpython-3.13> _run_suite
2024-06-06T14:41:45.9820311Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/test/libregrtest/single.py", line 37 in run_unittest
2024-06-06T14:41:45.9820929Z cpython-3.13>   File
2024-06-06T14:41:45.9821502Z cpython-3.13> "/build/Python-3.13.0b1/Lib/test/libregrtest/single.py", line 132 in test_func
2024-06-06T14:41:45.9822423Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/test/libregrtest/single.py", line 88 in regrtest_runner
2024-06-06T14:41:45.9823610Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/test/libregrtest/single.py", line 135 in _load_run_test
2024-06-06T14:41:45.9824601Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/test/libregrtest/single.py", line 178 in _runtest_env_changed_exc
2024-06-06T14:41:45.9825561Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/test/libregrtest/single.py", line 278 in _runtest
2024-06-06T14:41:45.9826480Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/test/libregrtest/single.py", line 309 in run_single_test
2024-06-06T14:41:45.9827378Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/test/libregrtest/main.py", line 355 in run_test
2024-06-06T14:41:45.9828320Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/test/libregrtest/main.py", line 389 in run_tests_sequentially
2024-06-06T14:41:45.9829253Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/test/libregrtest/main.py", line 533 in _run_tests
2024-06-06T14:41:45.9830257Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/test/libregrtest/main.py", line 568 in run_tests
2024-06-06T14:41:45.9831155Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/test/libregrtest/main.py", line 731 in main
2024-06-06T14:41:45.9831996Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/test/libregrtest/main.py", line 739 in main
2024-06-06T14:41:45.9832875Z cpython-3.13>   File "/build/Python-3.13.0b1/Lib/test/__main__.py", line 2 in <module>
2024-06-06T14:41:45.9833528Z cpython-3.13>   File "<frozen runpy>", line 88 in _run_code
2024-06-06T14:41:45.9834110Z cpython-3.13>   File "<frozen runpy>", line 198 in _run_module_as_main
2024-06-06T14:41:45.9834656Z cpython-3.13> Extension modules: _testinternalcapi
2024-06-06T14:41:45.9835059Z cpython-3.13> (total: 1)
2024-06-06T14:41:46.1367157Z cpython-3.13> Segmentation fault (core dumped)
2024-06-06T14:41:46.1368488Z cpython-3.13> Makefile:868: recipe for target 'profile-bolt-stamp' failed
2024-06-06T14:41:46.1369458Z cpython-3.13> make[1]: Leaving directory '/build/Python-3.13.0b1'
2024-06-06T14:41:46.1370196Z cpython-3.13> make[1]: *** [profile-bolt-stamp] Error 139
2024-06-06T14:41:46.1380350Z cpython-3.13> make: *** [bolt-opt] Error 2
2024-06-06T14:41:46.1381212Z cpython-3.13> Makefile:899: recipe for target 'bolt-opt' failed
2024-06-06T14:41:48.0010999Z Traceback (most recent call last):
2024-06-06T14:41:48.0021028Z   File "/home/runner/work/python-build-standalone/python-build-standalone/cpython-unix/build.py", line 1219, in <module>
2024-06-06T14:41:48.0021814Z     sys.exit(main())
2024-06-06T14:41:48.0022074Z              ^^^^^^
2024-06-06T14:41:48.0023383Z   File "/home/runner/work/python-build-standalone/python-build-standalone/cpython-unix/build.py", line 1201, in main
2024-06-06T14:41:48.0024527Z     build_cpython(
2024-06-06T14:41:48.0025830Z   File "/home/runner/work/python-build-standalone/python-build-standalone/cpython-unix/build.py", line 803, in build_cpython
2024-06-06T14:41:48.0027150Z     build_env.run("build-cpython.sh", environment=env)
2024-06-06T14:41:48.0028525Z   File "/home/runner/work/python-build-standalone/python-build-standalone/pythonbuild/buildenv.py", line 95, in run
2024-06-06T14:41:48.0029426Z     container_exec(self.container, program, user=user, environment=environment)
2024-06-06T14:41:48.0030512Z   File "/home/runner/work/python-build-standalone/python-build-standalone/pythonbuild/docker.py", line 140, in container_exec
2024-06-06T14:41:48.0031434Z     raise Exception("exit code %d from %s" % (inspect_res["ExitCode"], command))
2024-06-06T14:41:48.0032032Z Exception: exit code 2 from /build/build-cpython.sh
2024-06-06T14:41:48.0307350Z make: *** [Makefile:325: /home/runner/work/python-build-standalone/python-build-standalone/build/cpython-3.13.0b1-x86_64-unknown-linux-gnu-pgo.tar] Error 1
2024-06-06T14:41:48.0444158Z ##[error]Process completed with exit code 2.

@zanieb
Copy link
Owner Author

zanieb commented Jun 6, 2024

Also this weird error on the MUSL builds

2024-06-06T15:22:59.7323527Z cpython-3.13> checking for the platform triplet based on compiler characteristics...
2024-06-06T15:22:59.7534322Z cpython-3.13> x86_64-linux-musl
2024-06-06T15:22:59.7544473Z cpython-3.13> checking for multiarch...
2024-06-06T15:22:59.7721531Z cpython-3.13> configure: error: internal configure error for the platform triplet, please file a bug report
2024-06-06T15:23:03.4816270Z Traceback (most recent call last):
2024-06-06T15:23:03.4828543Z   File "/home/runner/work/python-build-standalone/python-build-standalone/cpython-unix/build.py", line 1219, in <module>
2024-06-06T15:23:03.4829764Z     sys.exit(main())
2024-06-06T15:23:03.4830118Z              ^^^^^^
2024-06-06T15:23:03.4831310Z   File "/home/runner/work/python-build-standalone/python-build-standalone/cpython-unix/build.py", line 1201, in main
2024-06-06T15:23:03.4832339Z     build_cpython(
2024-06-06T15:23:03.4833609Z   File "/home/runner/work/python-build-standalone/python-build-standalone/cpython-unix/build.py", line 803, in build_cpython
2024-06-06T15:23:03.4834795Z     build_env.run("build-cpython.sh", environment=env)
2024-06-06T15:23:03.4835741Z   File "/home/runner/work/python-build-standalone/python-build-standalone/pythonbuild/buildenv.py", line 95, in run
2024-06-06T15:23:03.4836594Z     container_exec(self.container, program, user=user, environment=environment)
2024-06-06T15:23:03.4837611Z   File "/home/runner/work/python-build-standalone/python-build-standalone/pythonbuild/docker.py", line 140, in container_exec
2024-06-06T15:23:03.4838520Z     raise Exception("exit code %d from %s" % (inspect_res["ExitCode"], command))
2024-06-06T15:23:03.4839101Z Exception: exit code 1 from /build/build-cpython.sh
2024-06-06T15:23:03.5124987Z make: *** [Makefile:325: /home/runner/work/python-build-standalone/python-build-standalone/build/cpython-3.13.0b1-x86_64_v3-unknown-linux-musl-debug.tar] Error 1
2024-06-06T15:23:03.5261193Z ##[error]Process completed with exit code 2.

https://github.com/python/cpython/blob/78634cfa3dd4b542897835d5f097604dbeb0f3fd/configure.ac#L1103

Whereas other builds have

2024-06-06T16:12:22.0282715Z cpython-3.13-host> x86_64-linux-gnu
2024-06-06T16:12:22.0305754Z cpython-3.13-host> checking for multiarch...
2024-06-06T16:12:22.0306612Z cpython-3.13-host> x86_64-linux-gnu

@zanieb
Copy link
Owner Author

zanieb commented Jun 6, 2024

macOS build fails with

2024-06-06T17:44:12.9632970Z cpython-3.13> clang  -fno-strict-overflow -g -Og -Wall -arch x86_64 -mmacosx-version-min=10.9 -Wno-nullability-completeness -Wno-expansion-to-defined -Wno-undef-prefix  -isysroot /Applications/Xcode_15.2.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX14.2.sdk -fPIC -I/var/folders/vy/h7r6h43j203gstfh6fj9_tyh0000gn/T/tmpwnx60s89/tools/deps/include -I/var/folders/vy/h7r6h43j203gstfh6fj9_tyh0000gn/T/tmpwnx60s89/tools/deps/include/ncursesw -I/var/folders/vy/h7r6h43j203gstfh6fj9_tyh0000gn/T/tmpwnx60s89/tools/deps/include/uuid -Werror=unguarded-availability-new   -std=c11 -Werror=implicit-function-declaration -fvisibility=hidden  -I./Include/internal -I./Include/internal/mimalloc  -I. -I./Include -arch x86_64 -mmacosx-version-min=10.9 -Wno-nullability-completeness -Wno-expansion-to-defined -Wno-undef-prefix  -isysroot /Applications/Xcode_15.2.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX14.2.sdk -fPIC -I/var/folders/vy/h7r6h43j203gstfh6fj9_tyh0000gn/T/tmpwnx60s89/tools/deps/include -I/var/folders/vy/h7r6h43j203gstfh6fj9_tyh0000gn/T/tmpwnx60s89/tools/deps/include/ncursesw -I/var/folders/vy/h7r6h43j203gstfh6fj9_tyh0000gn/T/tmpwnx60s89/tools/deps/include/uuid -Werror=unguarded-availability-new   -DPy_BUILD_CORE_BUILTIN -c ./Modules/signalmodule.c -o Modules/signalmodule.o
2024-06-06T17:44:13.1403670Z cpython-3.13> ./Modules/posixmodule.c:8753:11: error: 'ptsname_r' is only available on macOS 10.13.4 or newer [-Werror,-Wunguarded-availability-new]
2024-06-06T17:44:13.1450010Z cpython-3.13>  8753 |     ret = ptsname_r(fd, name, sizeof(name));
2024-06-06T17:44:13.1459740Z cpython-3.13>       |           ^~~~~~~~~
2024-06-06T17:44:13.1757100Z cpython-3.13> /Applications/Xcode_15.2.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX14.2.sdk/usr/include/stdlib.h:220:5: note: 'ptsname_r' has been marked as being introduced in macOS 10.13.4 here, but the deployment target is macOS 10.9.0
2024-06-06T17:44:13.2179560Z cpython-3.13>   220 | int ptsname_r(int fildes, char *buffer, size_t buflen) __API_AVAILABLE(macos(10.13.4), ios(11.3), tvos(11.3), watchos(4.3));
2024-06-06T17:44:13.2418270Z cpython-3.13>       |     ^
2024-06-06T17:44:13.2459020Z cpython-3.13> ./Modules/posixmodule.c:8753:11: note: enclose 'ptsname_r' in a __builtin_available check to silence this warning
2024-06-06T17:44:13.2467780Z cpython-3.13>  8753 |     ret = ptsname_r(fd, name, sizeof(name));
2024-06-06T17:44:13.2640700Z cpython-3.13>       |           ^~~~~~~~~
2024-06-06T17:44:13.2645940Z cpython-3.13> 1 error generated.
2024-06-06T17:44:13.2651400Z cpython-3.13> make: *** [Modules/posixmodule.o] Error 1
2024-06-06T17:44:13.2656630Z cpython-3.13> make: *** Waiting for unfinished jobs....
2024-06-06T17:44:13.6791750Z process exited 2

Probably related to python/cpython#102413 which is Python 3.13+

@zanieb
Copy link
Owner Author

zanieb commented Jun 7, 2024

Looks like upgrading to b2 causes failures in the builds that were previously succeeding.

@zanieb zanieb mentioned this pull request Sep 4, 2024
@zanieb zanieb closed this Sep 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants