You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When the jenkins job runs the cypress tests in the Functional test repo, we found that 2 alerting dashboards cypress tests are flaky when executed using a security-enabled cluster. As described in this comment, we can see that each of the tests passes in previous test runs. opensearch-project/alerting-dashboards-plugin#975 (comment)
To reproduce
We have difficulty reproducing the flakiness locally. The 2 tests that are called out as failing in the issue above pass reliably when executed locally using a security-enabled cluster.
Use docker to create a security-enabled domain with the frontend running
thanks @AWSHurneyt for creating the issue. When we say these tests are passing reliably when executed locally using a security-enabled cluster, are we running these individual tests or the full suite? I am wondering since the issue is related to the timeout, where test failed because it timed out waiting for the UI to load, it is a cleanup issue when all tests run together?
Can you also point out any resource contention issue, or limitations that these test might be running into based on the OS and OSD logs from the point of failures?
Describe the bug
When the jenkins job runs the cypress tests in the Functional test repo, we found that 2 alerting dashboards cypress tests are flaky when executed using a security-enabled cluster. As described in this comment, we can see that each of the tests passes in previous test runs.
opensearch-project/alerting-dashboards-plugin#975 (comment)
To reproduce
We have difficulty reproducing the flakiness locally. The 2 tests that are called out as failing in the issue above pass reliably when executed locally using a security-enabled cluster.
Expected behavior
No response
Screenshots
This test fail in this instance because the "select your tenant" window wasn't closed.
This test failed because it timed out waiting for the UI to load.
https://ci.opensearch.org/ci/dbc/integ-test-opensearch-dashboards/2.15.0/7742/linux/x64/deb/test-results/5966/integ-test/alertingDashboards/with-security/cypress-screenshots/plugins/alerting-dashboards-plugin/document_level_monitor_spec.js/DocumentLevelMonitor+--+can+be+created+--+by+extraction+query+editor+--+before+each+hook+%28failed%29.png
This test failed because it timed out waiting for the UI to load.
Host / Environment
No response
Additional context
No response
Relevant log output
No response
The text was updated successfully, but these errors were encountered: