Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add automated validation during releases #2524

Open
10 of 14 tasks
bbarani opened this issue Aug 29, 2022 · 1 comment
Open
10 of 14 tasks

Add automated validation during releases #2524

bbarani opened this issue Aug 29, 2022 · 1 comment
Assignees
Labels
enhancement New Enhancement good first issue Good for newcomers hacktoberfest Global event that encourages people to contribute to open-source.

Comments

@bbarani
Copy link
Member

bbarani commented Aug 29, 2022

Is your feature request related to a problem? Please describe

We are currently doing manual validation for verifying the artifacts, download links and signatures during release process. This is taking additional time and adding manual overhead during release process.

Describe the solution you'd like

Automate the below validation and verification process during OpenSearch releases,

Acceptance criteria:

The automated validation workflow should:

  • Automatically validate download URL's of OpenSearch artifacts
  • Download the OpenSearch distribution artifacts on DockerHub and ECR automatically
  • Validate the checksum of DockerHub and ECR images
  • Start and test the cluster after deploying the artifacts (TAR, Docker, RPM, Windows) for both X64 and ARM64
  • Validate the native plugin installation using TAR and Windows artifacts.
  • Signature validation.
  • Validate the artifact(s) signatures for all the supported artifacts including TAR, Docker, RPM, Windows
  • Verify the presence of released artifacts in maven nexus releases repo.

Describe alternatives you've considered

No response

Additional context

Need a cypress test to test the https://opensearch.org/ website clickstream links.

@bbarani bbarani added enhancement New Enhancement untriaged Issues that have not yet been triaged labels Aug 29, 2022
@prudhvigodithi prudhvigodithi removed the untriaged Issues that have not yet been triaged label Aug 30, 2022
@bbarani bbarani added the good first issue Good for newcomers label Sep 23, 2022
@bbarani bbarani assigned jordarlu and Divyaasm and unassigned jordarlu Sep 26, 2022
@bbarani bbarani added the hacktoberfest Global event that encourages people to contribute to open-source. label Oct 5, 2022
@gaiksaya
Copy link
Member

gaiksaya commented Oct 12, 2022

Proposal:

I believe it is better to have a validation framework (something similar to https://github.com/opensearch-project/opensearch-build/blob/main/src/sign_workflow/signer.py) with abstract methods like download, install, start_cluster, run_apis, etc.
This will allow us to have a uniform execution mechanism across different platforms like docker, rpm, tarballs, windows, macos, etc.
This framework then can be wrapped by a jenkins build library which can be called in CI workflows to run validation after each release.
cc: @Divyaasm

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New Enhancement good first issue Good for newcomers hacktoberfest Global event that encourages people to contribute to open-source.
Projects
Status: Planned (Next Quarter)
Development

No branches or pull requests

5 participants