Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Separate Robustness compaction and LazyFS test scenario #18144

Open
serathius opened this issue Jun 10, 2024 · 1 comment
Open

Separate Robustness compaction and LazyFS test scenario #18144

serathius opened this issue Jun 10, 2024 · 1 comment

Comments

@serathius
Copy link
Member

Which Github Action / Prow Jobs are flaking?

https://testgrid.k8s.io/sig-etcd-robustness#ci-etcd-robustness-amd64

Which tests are flaking?

TestRobustnessExploratory/Kubernetes/LowTraffic/ClusterOfSize1/LazyFS
TestRobustnessExploratory/Etcd/LowTraffic/ClusterOfSize1/LazyFS

Github Action / Prow Job link

https://prow.k8s.io/view/gs/kubernetes-jenkins/logs/ci-etcd-robustness-amd64/1799048278302527488

Reason for failure (if possible)

Since introduction of compaction in #17833 we started getting traffic.go:129: Requiring minimal 100.000000 qps before failpoint injection for test results to be reliable, got 89.482132 qps

I would like to propose to create a separate Compaction and LazyFS as they might be too heavy to CI. For example separate TestRobustnessExploratory/Etcd/LowTraffic/ClusterOfSize1 into:

  • TestRobustnessExploratory/Etcd/LowTraffic/ClusterOfSize1/Compact
  • TestRobustnessExploratory/Etcd/LowTraffic/ClusterOfSize1/LazyFS

TODO:

  • Add another scenario that uses traffic without compaction only when lazyfs is enabled
  • Possibly reduce number of runs to avoid another scenario causing timeout due to 3h timeout.

Anything else we need to know?

No response

@serathius
Copy link
Member Author

cc @MadhavJivrajani @siyuanfoundation @henrybear327 @fuweid

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

No branches or pull requests

2 participants