Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automate acceptance/expensive tests #856

Closed
ebezzi opened this issue Nov 8, 2023 · 1 comment
Closed

Automate acceptance/expensive tests #856

ebezzi opened this issue Nov 8, 2023 · 1 comment
Labels

Comments

@ebezzi
Copy link
Member

ebezzi commented Nov 8, 2023

Motivation

Currently acceptance tests need to be run manually on a large instance. They're currently run before we release an LTS but not when we release a new Census version. It would be good to run them automatically.

Proposals

  1. Create and push a script that sets up the environment, runs the tests and uploads the results to a permanent location (e.g. an S3 bucket). This isn't automation, but it will at least make the process less cumbersome.
  2. Create a Batch job that acts as a test runner. This has operational overhead (requires infra and to Dockerize the test runner itself), but it is a viable solution.
  3. Run the tests in GHA using a custom runner. Also a viable solution with less overhead, but the feasibility needs to be verified.
@ebezzi ebezzi added the tech label Nov 8, 2023
@bkmartinjr
Copy link
Contributor

Resolved by #897

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants