Trying to load botocore using awscrt version 0.19.10 on WSL leads to an abort #3056

ryancausey · 2023-11-12T23:16:35Z

Describe the bug

The 0.19.10 version of awscrt has an issue on WSL that leads to an abort: awslabs/aws-crt-python#524

Botocore needs to be updated to ether pin the latest version of awscrt or needs to use a range dependency specification so awscrt updates can automatically be pulled.

Expected Behavior

The pytest command to run successfully.

Current Behavior

$ poetry run pytest --capture=no
Fatal error condition occurred in /aws-crt-python/crt/aws-c-common/source/allocator.c:187: num != 0 && size != 0
Exiting Application
################################################################################
Stack trace:
################################################################################
/home/rccausey/.cache/pypoetry/virtualenvs/faunadb-management-M4Ph0FRZ-py3.11/lib/python3.11/site-packages/_awscrt.abi3.so(aws_backtrace_print+0x4f) [0x7fccb8bfaa8f]
/home/rccausey/.cache/pypoetry/virtualenvs/faunadb-management-M4Ph0FRZ-py3.11/lib/python3.11/site-packages/_awscrt.abi3.so(aws_fatal_assert+0x44) [0x7fccb8bef0b4]
/home/rccausey/.cache/pypoetry/virtualenvs/faunadb-management-M4Ph0FRZ-py3.11/lib/python3.11/site-packages/_awscrt.abi3.so(aws_mem_calloc+0xdd) [0x7fccb8bee43d]
/home/rccausey/.cache/pypoetry/virtualenvs/faunadb-management-M4Ph0FRZ-py3.11/lib/python3.11/site-packages/_awscrt.abi3.so(aws_s3_platform_info_loader_new+0x7c) [0x7fccb8b4c58c]
/home/rccausey/.cache/pypoetry/virtualenvs/faunadb-management-M4Ph0FRZ-py3.11/lib/python3.11/site-packages/_awscrt.abi3.so(aws_s3_library_init+0x53) [0x7fccb8b43ea3]
/home/rccausey/.cache/pypoetry/virtualenvs/faunadb-management-M4Ph0FRZ-py3.11/lib/python3.11/site-packages/_awscrt.abi3.so(PyInit__awscrt+0x10b) [0x7fccb8b3b8fb]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x28a68e) [0x7fccbb78068e]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x28643d) [0x7fccbb77c43d]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x1b1ded) [0x7fccbb6a7ded]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0x392d) [0x7fccbb5f8ead]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x25a531) [0x7fccbb750531]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x160824) [0x7fccbb656824]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyObject_CallMethodObjArgs+0xfd) [0x7fccbb656a2d]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyImport_ImportModuleLevelObject+0x501) [0x7fccbb77f401]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0xb5a9) [0x7fccbb600b29]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyEval_EvalCode+0x23f) [0x7fccbb7503cf]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x2562a0) [0x7fccbb74c2a0]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x1b1c76) [0x7fccbb6a7c76]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0x392d) [0x7fccbb5f8ead]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x25a531) [0x7fccbb750531]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x160824) [0x7fccbb656824]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyObject_CallMethodObjArgs+0xfd) [0x7fccbb656a2d]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyImport_ImportModuleLevelObject+0x501) [0x7fccbb77f401]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0xb5a9) [0x7fccbb600b29]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyEval_EvalCode+0x23f) [0x7fccbb7503cf]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x2562a0) [0x7fccbb74c2a0]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x1b1c76) [0x7fccbb6a7c76]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0x392d) [0x7fccbb5f8ead]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x25a531) [0x7fccbb750531]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x160824) [0x7fccbb656824]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyObject_CallMethodObjArgs+0xfd) [0x7fccbb656a2d]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyImport_ImportModuleLevelObject+0x501) [0x7fccbb77f401]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0xb5a9) [0x7fccbb600b29]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyEval_EvalCode+0x23f) [0x7fccbb7503cf]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x2562a0) [0x7fccbb74c2a0]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x1b1c76) [0x7fccbb6a7c76]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0x392d) [0x7fccbb5f8ead]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x25a531) [0x7fccbb750531]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x160824) [0x7fccbb656824]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyObject_CallMethodObjArgs+0xfd) [0x7fccbb656a2d]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyImport_ImportModuleLevelObject+0x501) [0x7fccbb77f401]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0xb5a9) [0x7fccbb600b29]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyEval_EvalCode+0x23f) [0x7fccbb7503cf]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x2562a0) [0x7fccbb74c2a0]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x1b1c76) [0x7fccbb6a7c76]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0x392d) [0x7fccbb5f8ead]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x25a531) [0x7fccbb750531]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x160824) [0x7fccbb656824]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyObject_CallMethodObjArgs+0xfd) [0x7fccbb656a2d]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyImport_ImportModuleLevelObject+0x501) [0x7fccbb77f401]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0xb5a9) [0x7fccbb600b29]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyEval_EvalCode+0x23f) [0x7fccbb7503cf]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x2562a0) [0x7fccbb74c2a0]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x1b1c76) [0x7fccbb6a7c76]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0x392d) [0x7fccbb5f8ead]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x25a531) [0x7fccbb750531]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x160824) [0x7fccbb656824]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyObject_CallMethodObjArgs+0xfd) [0x7fccbb656a2d]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyImport_ImportModuleLevelObject+0x501) [0x7fccbb77f401]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x253cfc) [0x7fccbb749cfc]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x1b1c76) [0x7fccbb6a7c76]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0x392d) [0x7fccbb5f8ead]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x25a531) [0x7fccbb750531]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x160824) [0x7fccbb656824]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyObject_CallMethodObjArgs+0xfd) [0x7fccbb656a2d]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyImport_ImportModuleLevelObject+0x501) [0x7fccbb77f401]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0xb5a9) [0x7fccbb600b29]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyEval_EvalCode+0x23f) [0x7fccbb7503cf]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x2562a0) [0x7fccbb74c2a0]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x1b1c76) [0x7fccbb6a7c76]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0x392d) [0x7fccbb5f8ead]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x25a531) [0x7fccbb750531]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x160824) [0x7fccbb656824]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyObject_CallMethodObjArgs+0xfd) [0x7fccbb656a2d]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyImport_ImportModuleLevelObject+0x501) [0x7fccbb77f401]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x253cfc) [0x7fccbb749cfc]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x1b1c76) [0x7fccbb6a7c76]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0x392d) [0x7fccbb5f8ead]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x25a531) [0x7fccbb750531]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x160824) [0x7fccbb656824]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyObject_CallMethodObjArgs+0xfd) [0x7fccbb656a2d]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyImport_ImportModuleLevelObject+0x162) [0x7fccbb77f062]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0xb5a9) [0x7fccbb600b29]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyEval_EvalCode+0x23f) [0x7fccbb7503cf]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x2562a0) [0x7fccbb74c2a0]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x1b1c76) [0x7fccbb6a7c76]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0x392d) [0x7fccbb5f8ead]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x25a531) [0x7fccbb750531]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x160824) [0x7fccbb656824]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyObject_CallMethodObjArgs+0xfd) [0x7fccbb656a2d]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyImport_ImportModuleLevelObject+0x501) [0x7fccbb77f401]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0xb5a9) [0x7fccbb600b29]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyEval_EvalCode+0x23f) [0x7fccbb7503cf]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x2562a0) [0x7fccbb74c2a0]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x1b1c76) [0x7fccbb6a7c76]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0x392d) [0x7fccbb5f8ead]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x25a531) [0x7fccbb750531]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x160824) [0x7fccbb656824]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyObject_CallMethodObjArgs+0xfd) [0x7fccbb656a2d]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyImport_ImportModuleLevelObject+0x501) [0x7fccbb77f401]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0xb5a9) [0x7fccbb600b29]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyEval_EvalCode+0x23f) [0x7fccbb7503cf]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x2562a0) [0x7fccbb74c2a0]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x1b1c76) [0x7fccbb6a7c76]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0x392d) [0x7fccbb5f8ead]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x25a531) [0x7fccbb750531]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x160824) [0x7fccbb656824]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyObject_CallMethodObjArgs+0xfd) [0x7fccbb656a2d]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyImport_ImportModuleLevelObject+0x501) [0x7fccbb77f401]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0xb5a9) [0x7fccbb600b29]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyEval_EvalCode+0x23f) [0x7fccbb7503cf]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x2562a0) [0x7fccbb74c2a0]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x1b1c76) [0x7fccbb6a7c76]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0x392d) [0x7fccbb5f8ead]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x25a531) [0x7fccbb750531]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x160824) [0x7fccbb656824]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyObject_CallMethodObjArgs+0xfd) [0x7fccbb656a2d]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyImport_ImportModuleLevelObject+0x501) [0x7fccbb77f401]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0xb5a9) [0x7fccbb600b29]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(PyEval_EvalCode+0x23f) [0x7fccbb7503cf]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x2562a0) [0x7fccbb74c2a0]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0x5f9c) [0x7fccbb5fb51c]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x25a531) [0x7fccbb750531]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x163026) [0x7fccbb659026]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyEval_EvalFrameDefault+0x392d) [0x7fccbb5f8ead]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(+0x25a531) [0x7fccbb750531]
/home/rccausey/.pyenv/versions/3.11.4/lib/libpython3.11.so.1.0(_PyObject_FastCallDictTstate+0xd4) [0x7fccbb6560e4]
Aborted

Reproduction Steps

Install boto3 version = "1.28.78" with the CRT extra specified.
Install botocore version = "1.31.84" with the CRT extra specified.
Attempt to run code that imports and uses boto3

Possible Solution

Botocore needs to be updated to ether pin the latest version of awscrt or needs to use a range dependency specification so awscrt updates can automatically be pulled.

Additional Information/Context

SDK version used

1.31.84

Environment details (OS name and version, etc.)

Ubuntu 22.04.3 LTS on WSL2

The text was updated successfully, but these errors were encountered:

tim-finnigan · 2023-11-13T01:52:16Z

Hi @ryancausey thanks for reporting this. The team is aware of this issue and currently tracking a related issue here in the CLI repository: aws/aws-cli#8320. We will have more updates to share soon.

github-actions · 2023-11-13T16:33:03Z

⚠️COMMENT VISIBILITY WARNING⚠️

Comments on closed issues are hard for our team to see.
If you need more assistance, please either tag a team member or open a new issue that references this one.
If you wish to keep having a conversation with other community members under this issue feel free to do so.

ryancausey added bug This issue is a confirmed bug. needs-triage This issue or PR still needs to be triaged. labels Nov 12, 2023

tim-finnigan changed the title ~~Trying to load botocoare using awscrt version 0.19.10 on WSL leads to an abort~~ Trying to load botocore using awscrt version 0.19.10 on WSL leads to an abort Nov 13, 2023

tim-finnigan added dependencies This issue is a problem in a dependency. and removed needs-triage This issue or PR still needs to be triaged. labels Nov 13, 2023

nateprewitt linked a pull request Nov 13, 2023 that will close this issue

Update awcrt version to 0.19.12 #3057

Merged

nateprewitt closed this as completed in #3057 Nov 13, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Trying to load botocore using awscrt version 0.19.10 on WSL leads to an abort #3056

Trying to load botocore using awscrt version 0.19.10 on WSL leads to an abort #3056

ryancausey commented Nov 12, 2023

tim-finnigan commented Nov 13, 2023

github-actions bot commented Nov 13, 2023