Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(issue_cache): add pull-requests to cache #7850

Merged
merged 2 commits into from
Jul 9, 2024

Conversation

fruch
Copy link
Contributor

@fruch fruch commented Jul 4, 2024

in some places we are using PRs and not issue to identify
if we should be skipping something in the test code

we now generate two diffrent cache files on s3 for each repository
one for the issues and one for the pull requests

client code is merging it to once local cache, so it's mentioning
of either one should be working as expect, and read from cache,
not using affecting the hourly rate-limit

Ref: https://github.com/scylladb/qa-tasks/issues/1735

Testing

  • unit tests
  • integration tests

PR pre-checks (self review)

  • I added the relevant backport labels
  • I didn't leave commented-out/debugging code

Reminders

  • Add New configuration option and document them (in sdcm/sct_config.py)
  • Add unit tests to cover my changes (under unit-test/ folder)
  • Update the Readme/doc folder relevant to this change (if needed)

@fruch fruch requested review from vponomaryov and soyacz July 4, 2024 12:19
@fruch fruch added the backport/none Backport is not required label Jul 4, 2024
@fruch fruch marked this pull request as ready for review July 4, 2024 12:20
@fruch fruch requested a review from enaydanov July 4, 2024 12:20
.github/dump_issues.py Outdated Show resolved Hide resolved
@fruch fruch force-pushed the add_PRs_to_issue_cache_in_s3 branch 2 times, most recently from f1585ae to 0afb0b3 Compare July 4, 2024 17:34
soyacz
soyacz previously approved these changes Jul 8, 2024
Copy link
Contributor

@soyacz soyacz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@fruch fruch force-pushed the add_PRs_to_issue_cache_in_s3 branch from cc2d8c8 to eca5e68 Compare July 8, 2024 18:53
@fruch fruch added the test-integration Enable running the integration tests suite label Jul 8, 2024
fruch added 2 commits July 8, 2024 22:01
in some places we are using PRs and not issue to identify
if we should be skipping something in the test code

we now generate two diffrent cache files on s3 for each repository
one for the issues and one for the pull requests

client code is merging it to once local cache, so it's mentioning
of either one should be working as expect, and read from cache,
not using affecting the hourly rate-limit

Ref: scylladb/qa-tasks#1735
@fruch fruch force-pushed the add_PRs_to_issue_cache_in_s3 branch from eca5e68 to 7b0145f Compare July 8, 2024 19:02
@fruch
Copy link
Contributor Author

fruch commented Jul 9, 2024

one integration test failed:

 FAILED unit_tests/test_config_get_version_based_on_conf.py::test_images[azure-master] - ValueError: Azure Image for scylla_version='master:latest' not found in eastus

not related to this change at all

@fruch fruch added backport/6.0 backport/2024.2 Need backport to 2024.2 and removed backport/none Backport is not required labels Jul 9, 2024
@fruch
Copy link
Contributor Author

fruch commented Jul 9, 2024

one integration test failed:

 FAILED unit_tests/test_config_get_version_based_on_conf.py::test_images[azure-master] - ValueError: Azure Image for scylla_version='master:latest' not found in eastus

not related to this change at all

smells like a bug in the azure client, it's cutting some responses in half, and getting invalid jsons...
and seems like this issue:
Azure/azure-rest-api-specs#25455

@fruch fruch merged commit 6f4b284 into master Jul 9, 2024
11 of 13 checks passed
@soyacz
Copy link
Contributor

soyacz commented Jul 9, 2024

one integration test failed:

 FAILED unit_tests/test_config_get_version_based_on_conf.py::test_images[azure-master] - ValueError: Azure Image for scylla_version='master:latest' not found in eastus

not related to this change at all

smells like a bug in the azure client, it's cutting some responses in half, and getting invalid jsons... and seems like this issue: Azure/azure-rest-api-specs#25455

does it reproduce often? Or this is the first case seen?

Comment on lines +6 to +8
# TODO: Add for test, remove before merge
push:
pull_request:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sounds like undesired part was merged.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, I reverted it out

since for testing those github action, I open the PR from the main repo.
I did a mistake and push the changes to my fork, and merged.

anyhow I've pull back the unrelated commit from master

@scylladbbot scylladbbot removed the backport/2024.2 Need backport to 2024.2 label Jul 9, 2024
@scylladbbot scylladbbot added the backport/2024.2-done Commit backported to 2024.2 label Jul 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport/6.0 backport/2024.2-done Commit backported to 2024.2 promoted-to-master test-integration Enable running the integration tests suite
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants