Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NET-11154] test: fix Envoy int tests and add container logs #21674

Merged
merged 1 commit into from
Aug 30, 2024

Conversation

zalimeni
Copy link
Member

@zalimeni zalimeni commented Aug 27, 2024

Correctly set the the version of Consul built by the dev-build job, which is then copied into the Consul dev image used in integration tests.

This was causing failures starting sidecar proxies via consul connect envoy due to a mismatch between the (incorrect) Consul binary's supported Envoy versions and the (correct) Envoy version under test.

Also add debug log uploads to each int test so we can more easily diagnose this sort of failure in the future, as it was entirely hidden in test output.

What's most unintuitive about this, is that the Consul Docker image used as a base for the tests was correct - it was only the replaced binary in that image that was wrong.

This change does not need to be backported since it's made within scheduled workflows run from main. Note that only 1.19 tests run on CE; the rest will exclusively affect Ent.

PR Checklist

  • updated test coverage
  • external facing docs updated
  • appropriate backport labels added
  • not a security concern

@zalimeni zalimeni added pr/no-changelog PR does not need a corresponding .changelog entry pr/no-backport labels Aug 27, 2024
@github-actions github-actions bot added type/ci Relating to continuous integration (CI) tooling for testing or releases theme/contributing Additions and enhancements to community contributing materials labels Aug 27, 2024
- name: Docker build
run: docker build -t consul:local -f ./build-support/docker/Consul-Dev.dockerfile ./bin

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This and above matches later nightly files for consistency

Correctly set the the version of Consul built by the `dev-build` job,
which is then copied into the Consul dev image used in integration
tests.

This was causing failures starting sidecar proxies via `consul connect
envoy` due to a mismatch between the (incorrect) Consul binary's
supported Envoy versions and the (correct) Envoy version under test.

Also add debug log uploads to each int test so we can more easily
diagnose this sort of failure in the future, as it was entirely hidden
in test output.
@zalimeni zalimeni force-pushed the zalimeni/fix-consul-version-nightly-envoy-tests branch from 92f0aa2 to a7f5962 Compare August 27, 2024 17:25
branch-name: "release/1.17.x"
branch-name: "release/1.18.x"
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This was causing failures like the following in container logs:
image

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good find!

Copy link
Member

@nathancoleman nathancoleman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks a ton for tracking this down and fixing it!

@zalimeni
Copy link
Member Author

To call out explicitly as well: I think the best next improvement here would be to convert all of these to a reusable workflow invoked once per nightly workflow. That said, I wanted to keep scope tight for this change. Hopefully we can follow up on that soon.

@zalimeni
Copy link
Member Author

Thanks a ton for tracking this down and fixing it!

Thanks @nathancoleman and np!

@zalimeni zalimeni merged commit 188af1c into main Aug 30, 2024
91 checks passed
@zalimeni zalimeni deleted the zalimeni/fix-consul-version-nightly-envoy-tests branch August 30, 2024 20:25
philrenaud pushed a commit that referenced this pull request Sep 12, 2024
Correctly set the the version of Consul built by the `dev-build` job,
which is then copied into the Consul dev image used in integration
tests.

This was causing failures starting sidecar proxies via `consul connect
envoy` due to a mismatch between the (incorrect) Consul binary's
supported Envoy versions and the (correct) Envoy version under test.

Also add debug log uploads to each int test so we can more easily
diagnose this sort of failure in the future, as it was entirely hidden
in test output.
@zalimeni zalimeni changed the title test: fix Envoy int tests and add container logs [NET-11154] test: fix Envoy int tests and add container logs Sep 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
pr/no-backport pr/no-changelog PR does not need a corresponding .changelog entry theme/contributing Additions and enhancements to community contributing materials type/ci Relating to continuous integration (CI) tooling for testing or releases
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants