Skip to content

feat(toxgen): Generate TESTPATH for integrated test suites #4863

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 4 commits into from
Sep 25, 2025
Merged

feat(toxgen): Generate TESTPATH for integrated test suites #4863

merged 4 commits into from
Sep 25, 2025

Conversation

sentrivana
Copy link
Contributor

Description

Make toxgen generate the TESTPATH env var for integrated test suites, removing a manual step when adding a new test suite.

Issues

Closes #4536

Reminders

@sentrivana sentrivana changed the title feat(toxgen): Generate TESTPATHs for integrated test suites feat(toxgen): Generate TESTPATH for integrated test suites Sep 25, 2025
@codecov Codecov
Copy link

codecov bot commented Sep 25, 2025 •
edited
Loading

❌ 64 Tests Failed:

Tests completed Failed Passed Skipped
18524 64 18460 2505
View the top 3 failed test(s) by shortest run time 
::tests.integrations.fastapi.test_fastapi
Stack Traces | 0s run time 
.tox/py3.8-aws_lambda/lib/python3.8....../site-packages/starlette/testclient.py:32: in <module>
    import httpx
E   ModuleNotFoundError: No module named 'httpx'

During handling of the above exception, another exception occurred:
.../integrations/fastapi/test_fastapi.py:10: in <module>
    from fastapi.testclient import TestClient
.tox/py3.8-aws_lambda/lib/python3.8.../site-packages/fastapi/testclient.py:1: in <module>
    from starlette.testclient import TestClient as TestClient  # noqa
.tox/py3.8-aws_lambda/lib/python3.8....../site-packages/starlette/testclient.py:34: in <module>
    raise RuntimeError(
E   RuntimeError: The starlette.testclient module requires the httpx package to be installed.
E   You can install this with:
E       $ pip install httpx
::tests.integrations.fastapi.test_fastapi
Stack Traces | 0s run time 
.tox/py3.13-aws_lambda/lib/python3.13....../site-packages/starlette/testclient.py:44: in <module>
    import httpx
E   ModuleNotFoundError: No module named 'httpx'

During handling of the above exception, another exception occurred:
.../integrations/fastapi/test_fastapi.py:10: in <module>
    from fastapi.testclient import TestClient
.tox/py3.13-aws_lambda/lib/python3.13.../site-packages/fastapi/testclient.py:1: in <module>
    from starlette.testclient import TestClient as TestClient  # noqa
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.tox/py3.13-aws_lambda/lib/python3.13....../site-packages/starlette/testclient.py:46: in <module>
    raise RuntimeError(
E   RuntimeError: The starlette.testclient module requires the httpx package to be installed.
E   You can install this with:
E       $ pip install httpx
::tests.integrations.fastapi.test_fastapi
Stack Traces | 0s run time 
.tox/py3.9-aws_lambda/lib/python3.9....../site-packages/starlette/testclient.py:44: in <module>
    import httpx
E   ModuleNotFoundError: No module named 'httpx'

During handling of the above exception, another exception occurred:
.../integrations/fastapi/test_fastapi.py:10: in <module>
    from fastapi.testclient import TestClient
.tox/py3.9-aws_lambda/lib/python3.9.../site-packages/fastapi/testclient.py:1: in <module>
    from starlette.testclient import TestClient as TestClient  # noqa
.tox/py3.9-aws_lambda/lib/python3.9....../site-packages/starlette/testclient.py:46: in <module>
    raise RuntimeError(
E   RuntimeError: The starlette.testclient module requires the httpx package to be installed.
E   You can install this with:
E       $ pip install httpx
::tests.integrations.fastapi.test_fastapi
Stack Traces | 0s run time 
.tox/py3.11-aws_lambda/lib/python3.11....../site-packages/starlette/testclient.py:44: in <module>
    import httpx
E   ModuleNotFoundError: No module named 'httpx'

During handling of the above exception, another exception occurred:
.../integrations/fastapi/test_fastapi.py:10: in <module>
    from fastapi.testclient import TestClient
.tox/py3.11-aws_lambda/lib/python3.11.../site-packages/fastapi/testclient.py:1: in <module>
    from starlette.testclient import TestClient as TestClient  # noqa
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.tox/py3.11-aws_lambda/lib/python3.11....../site-packages/starlette/testclient.py:46: in <module>
    raise RuntimeError(
E   RuntimeError: The starlette.testclient module requires the httpx package to be installed.
E   You can install this with:
E       $ pip install httpx
::tests.integrations.flask.test_flask
Stack Traces | 0s run time 
ImportError while importing test module '.../integrations/flask/test_flask.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
.tox/py3.8-aws_lambda/lib/python3.8.../site-packages/_pytest/python.py:493: in importtestmodule
    mod = import_path(
.tox/py3.8-aws_lambda/lib/python3.8.../site-packages/_pytest/pathlib.py:587: in import_path
    importlib.import_module(module_name)
.../hostedtoolcache/Python/3.8.18.../x64/lib/python3.8/importlib/__init__.py:127: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
<frozen importlib._bootstrap>:1014: in _gcd_import
    ???
<frozen importlib._bootstrap>:991: in _find_and_load
    ???
<frozen importlib._bootstrap>:975: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:671: in _load_unlocked
    ???
.tox/py3.8-aws_lambda/lib/python3.8.../_pytest/assertion/rewrite.py:185: in exec_module
    exec(co, module.__dict__)
.../integrations/flask/test_flask.py:16: in <module>
    from flask_login import LoginManager, login_user
E   ModuleNotFoundError: No module named 'flask_login'
::tests.integrations.flask.test_flask
Stack Traces | 0s run time 
ImportError while importing test module '.../integrations/flask/test_flask.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
.tox/py3.11-aws_lambda/lib/python3.11.../site-packages/_pytest/python.py:498: in importtestmodule
    mod = import_path(
.tox/py3.11-aws_lambda/lib/python3.11.../site-packages/_pytest/pathlib.py:587: in import_path
    importlib.import_module(module_name)
.../hostedtoolcache/Python/3.11.13.../x64/lib/python3.11/importlib/__init__.py:126: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<frozen importlib._bootstrap>:1204: in _gcd_import
    ???
<frozen importlib._bootstrap>:1176: in _find_and_load
    ???
<frozen importlib._bootstrap>:1147: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:690: in _load_unlocked
    ???
.tox/py3.11-aws_lambda/lib/python3.11.../_pytest/assertion/rewrite.py:186: in exec_module
    exec(co, module.__dict__)
.../integrations/flask/test_flask.py:16: in <module>
    from flask_login import LoginManager, login_user
E   ModuleNotFoundError: No module named 'flask_login'
::tests.integrations.flask.test_flask
Stack Traces | 0s run time 
ImportError while importing test module '.../integrations/flask/test_flask.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
.tox/py3.13-aws_lambda/lib/python3.13.../site-packages/_pytest/python.py:498: in importtestmodule
    mod = import_path(
.tox/py3.13-aws_lambda/lib/python3.13.../site-packages/_pytest/pathlib.py:587: in import_path
    importlib.import_module(module_name)
.../hostedtoolcache/Python/3.13.7.../x64/lib/python3.13/importlib/__init__.py:88: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<frozen importlib._bootstrap>:1387: in _gcd_import
    ???
<frozen importlib._bootstrap>:1360: in _find_and_load
    ???
<frozen importlib._bootstrap>:1331: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:935: in _load_unlocked
    ???
.tox/py3.13-aws_lambda/lib/python3.13.../_pytest/assertion/rewrite.py:186: in exec_module
    exec(co, module.__dict__)
.../integrations/flask/test_flask.py:16: in <module>
    from flask_login import LoginManager, login_user
E   ModuleNotFoundError: No module named 'flask_login'
::tests.integrations.flask.test_flask
Stack Traces | 0s run time 
ImportError while importing test module '.../integrations/flask/test_flask.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
.tox/py3.9-aws_lambda/lib/python3.9.../site-packages/_pytest/python.py:498: in importtestmodule
    mod = import_path(
.tox/py3.9-aws_lambda/lib/python3.9.../site-packages/_pytest/pathlib.py:587: in import_path
    importlib.import_module(module_name)
.../hostedtoolcache/Python/3.9.23.../x64/lib/python3.9/importlib/__init__.py:127: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
<frozen importlib._bootstrap>:1030: in _gcd_import
    ???
<frozen importlib._bootstrap>:1007: in _find_and_load
    ???
<frozen importlib._bootstrap>:986: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:680: in _load_unlocked
    ???
.tox/py3.9-aws_lambda/lib/python3.9.../_pytest/assertion/rewrite.py:186: in exec_module
    exec(co, module.__dict__)
.../integrations/flask/test_flask.py:16: in <module>
    from flask_login import LoginManager, login_user
E   ModuleNotFoundError: No module named 'flask_login'
::tests.integrations.starlette.test_starlette
Stack Traces | 0s run time 
.tox/py3.13-aws_lambda/lib/python3.13....../site-packages/starlette/testclient.py:44: in <module>
    import httpx
E   ModuleNotFoundError: No module named 'httpx'

During handling of the above exception, another exception occurred:
.../integrations/starlette/test_starlette.py:33: in <module>
    from starlette.testclient import TestClient
.tox/py3.13-aws_lambda/lib/python3.13....../site-packages/starlette/testclient.py:46: in <module>
    raise RuntimeError(
E   RuntimeError: The starlette.testclient module requires the httpx package to be installed.
E   You can install this with:
E       $ pip install httpx
::tests.integrations.starlette.test_starlette
Stack Traces | 0s run time 
.tox/py3.11-aws_lambda/lib/python3.11....../site-packages/starlette/testclient.py:44: in <module>
    import httpx
E   ModuleNotFoundError: No module named 'httpx'

During handling of the above exception, another exception occurred:
.../integrations/starlette/test_starlette.py:33: in <module>
    from starlette.testclient import TestClient
.tox/py3.11-aws_lambda/lib/python3.11....../site-packages/starlette/testclient.py:46: in <module>
    raise RuntimeError(
E   RuntimeError: The starlette.testclient module requires the httpx package to be installed.
E   You can install this with:
E       $ pip install httpx
::tests.integrations.starlette.test_starlette
Stack Traces | 0s run time 
.tox/py3.8-aws_lambda/lib/python3.8....../site-packages/starlette/testclient.py:32: in <module>
    import httpx
E   ModuleNotFoundError: No module named 'httpx'

During handling of the above exception, another exception occurred:
.../integrations/starlette/test_starlette.py:33: in <module>
    from starlette.testclient import TestClient
.tox/py3.8-aws_lambda/lib/python3.8....../site-packages/starlette/testclient.py:34: in <module>
    raise RuntimeError(
E   RuntimeError: The starlette.testclient module requires the httpx package to be installed.
E   You can install this with:
E       $ pip install httpx
::tests.integrations.starlette.test_starlette
Stack Traces | 0s run time 
.tox/py3.9-aws_lambda/lib/python3.9....../site-packages/starlette/testclient.py:44: in <module>
    import httpx
E   ModuleNotFoundError: No module named 'httpx'

During handling of the above exception, another exception occurred:
.../integrations/starlette/test_starlette.py:33: in <module>
    from starlette.testclient import TestClient
.tox/py3.9-aws_lambda/lib/python3.9....../site-packages/starlette/testclient.py:46: in <module>
    raise RuntimeError(
E   RuntimeError: The starlette.testclient module requires the httpx package to be installed.
E   You can install this with:
E       $ pip install httpx
tests.integrations.asyncio.test_asyncio::test_create_task
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_exception
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_exception
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_exception
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_gather
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_gather
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_gather
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_span_origin
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_span_origin
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_span_origin
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_task_result
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_task_result
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_task_result
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_task_with_context
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_ai_monitoring::test_ai_track_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_ai_monitoring::test_ai_track_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_ai_monitoring::test_ai_track_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_ai_monitoring::test_ai_track_async_with_explicit_op
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_ai_monitoring::test_ai_track_async_with_explicit_op
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_ai_monitoring::test_ai_track_async_with_explicit_op
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_ai_monitoring::test_ai_track_async_with_tags
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_ai_monitoring::test_ai_track_async_with_tags
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_ai_monitoring::test_ai_track_async_with_tags
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_contextmanager_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_contextmanager_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_contextmanager_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_contextmanager_error_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_contextmanager_error_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_decorator_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_decorator_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_decorator_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_decorator_error_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_decorator_error_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_decorator_error_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_feature_flags::test_featureflags_integration_spans_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_feature_flags::test_featureflags_integration_spans_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_feature_flags::test_featureflags_integration_spans_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.tracing.test_decorator::test_functions_to_trace_signature_unchanged_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.tracing.test_decorator::test_functions_to_trace_signature_unchanged_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.tracing.test_decorator::test_functions_to_trace_signature_unchanged_async
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.tracing.test_decorator::test_trace_decorator_async_no_trx
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.tracing.test_decorator::test_trace_decorator_async_no_trx
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.tracing.test_decorator::test_trace_decorator_async_no_trx
Stack Traces | 0.001s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_create_task
Stack Traces | 0.002s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.integrations.asyncio.test_asyncio::test_create_task
Stack Traces | 0.002s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.test_crons::test_contextmanager_error_async
Stack Traces | 0.002s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.tracing.test_decorator::test_trace_decorator_async
Stack Traces | 0.003s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.tracing.test_decorator::test_trace_decorator_async
Stack Traces | 0.003s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.tracing.test_decorator::test_trace_decorator_async
Stack Traces | 0.003s run time 
async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted
tests.utils.test_contextvars::test_leaks[threads]
Stack Traces | 0.066s run time 
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:341: in from_call
    result: Optional[TResult] = func()
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:262: in <lambda>
    lambda: ihook(item=item, **kwds), when=when, reraise=reraise
.tox/py3.7-opentelemetry/lib/python3.7.../site-packages/pluggy/_hooks.py:433: in __call__
    return self._hookexec(self.name, self._hookimpls, kwargs, firstresult)
.tox/py3.7-opentelemetry/lib/python3.7.../site-packages/pluggy/_manager.py:112: in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:157: in pytest_runtest_setup
    item.session._setupstate.setup(item)
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:485: in setup
    assert col in needed_collectors, "previous item was not torn down properly"
E   AssertionError: previous item was not torn down properly
tests.utils.test_contextvars::test_leaks[eventlet]
Stack Traces | 0.067s run time 
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:341: in from_call
    result: Optional[TResult] = func()
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:262: in <lambda>
    lambda: ihook(item=item, **kwds), when=when, reraise=reraise
.tox/py3.7-opentelemetry/lib/python3.7.../site-packages/pluggy/_hooks.py:433: in __call__
    return self._hookexec(self.name, self._hookimpls, kwargs, firstresult)
.tox/py3.7-opentelemetry/lib/python3.7.../site-packages/pluggy/_manager.py:112: in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:157: in pytest_runtest_setup
    item.session._setupstate.setup(item)
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:485: in setup
    assert col in needed_collectors, "previous item was not torn down properly"
E   AssertionError: previous item was not torn down properly
tests.utils.test_contextvars::test_leaks[greenlet]
Stack Traces | 0.067s run time 
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:341: in from_call
    result: Optional[TResult] = func()
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:262: in <lambda>
    lambda: ihook(item=item, **kwds), when=when, reraise=reraise
.tox/py3.7-opentelemetry/lib/python3.7.../site-packages/pluggy/_hooks.py:433: in __call__
    return self._hookexec(self.name, self._hookimpls, kwargs, firstresult)
.tox/py3.7-opentelemetry/lib/python3.7.../site-packages/pluggy/_manager.py:112: in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:157: in pytest_runtest_setup
    item.session._setupstate.setup(item)
.tox/py3.7-opentelemetry/lib/python3.7............/site-packages/_pytest/runner.py:485: in setup
    assert col in needed_collectors, "previous item was not torn down properly"
E   AssertionError: previous item was not torn down properly

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

@sentrivana sentrivana marked this pull request as ready for review September 25, 2025 08:46
@sentrivana sentrivana requested a review from a team as a code owner September 25, 2025 08:46
alexander-alderman-webb
alexander-alderman-webb approved these changes Sep 25, 2025
View reviewed changes
tox.ini
Comment on lines +718 to +724
asgi: TESTPATH=tests/integrations/asgi
aws_lambda: TESTPATH=tests/integrations/aws_lambda
cloud_resource_context: TESTPATH=tests/integrations/cloud_resource_context
gcp: TESTPATH=tests/integrations/gcp
opentelemetry: TESTPATH=tests/integrations/opentelemetry
potel: TESTPATH=tests/integrations/opentelemetry
socket: TESTPATH=tests/integrations/socket
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good!

I am wondering if we can auto-generate the TESTPATH for all integrations? The ones I have highlighted are still explicitly specified in tox.ninja.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Those are hardcoded since those are tests suites that are not managed by toxgen. But agree that it looks a bit strange. Added at least a small comment e1a547c to clarify the different treatment for future reference.

@sentrivana sentrivana enabled auto-merge (squash) September 25, 2025 10:22
@sentrivana sentrivana merged commit 3a43dc9 into master Sep 25, 2025
113 checks passed
@sentrivana sentrivana deleted the ivana/toxgen/testpath branch September 25, 2025 10:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@alexander-alderman-webb alexander-alderman-webb alexander-alderman-webb approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Make toxgen generate TESTPATH env var if missing
2 participants
@sentrivana @alexander-alderman-webb