Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[meta] Improve system tests robustness #1537

Closed
3 tasks done
marc-gr opened this issue Nov 7, 2023 · 0 comments · Fixed by #1540
Closed
3 tasks done

[meta] Improve system tests robustness #1537

marc-gr opened this issue Nov 7, 2023 · 0 comments · Fixed by #1540
Assignees
Labels
enhancement New feature or request

Comments

@marc-gr
Copy link
Contributor

marc-gr commented Nov 7, 2023

Several integrations that rely on external APIs use stream as their test services to build mocks and run system tests.

There are some blind spots when it comes to detecting config errors that could lead to wrong pagination, infinite pagination loops, etc. mainly caused by the inability of elastic-package to detect anything else than is there any data? in the data stream or is there the expected number of events? if assert.hit_count is set, which makes things better but is not enough.

As part of an effort to improve system tests robustness some things could be improved:

Once this is done we can leverage these new behavior for system tests that require it.

@marc-gr marc-gr changed the title Improve system tests robustness [meta] Improve system tests robustness Nov 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
1 participant