Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI: enhance nightly backward compatibility testing workflow #2083

Open
wants to merge 12 commits into
base: main
Choose a base branch
from

Conversation

dlachaume
Copy link
Collaborator

@dlachaume dlachaume commented Nov 4, 2024

Content

This PR includes enhancements for the nightly backward compatibility testing workflow.
It schedules the workflow to run at night (2:30 UTC) and uploads artifacts upon failure.

Additionally, it introduces a comprehensive published summary for the runs:

Screenshot 2024-11-04 at 16 36 52

Pre-submit checklist

  • Branch
    • Commit sequence broadly makes sense
    • Key commits have useful messages
  • PR
    • No clippy warnings in the CI
    • Self-reviewed the diff
    • Useful pull request description
    • Reviewer requested

Issue(s)

Closes #2027

@dlachaume dlachaume self-assigned this Nov 4, 2024
Copy link

github-actions bot commented Nov 4, 2024

Test Results

    4 files  ±0     51 suites  ±0   10m 36s ⏱️ +2s
1 418 tests ±0  1 418 ✅ ±0  0 💤 ±0  0 ❌ ±0 
1 629 runs  ±0  1 629 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 17f8c3c. ± Comparison against base commit 38ff571.

♻️ This comment has been updated with latest results.

Copy link
Collaborator

@Alenar Alenar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

|| (echo "SUCCESS=false" >> $GITHUB_ENV && exit 1)

- name: Define the JSON file name for the test result
if: always()
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you want this step to run even if the run is cancelled ? If yes keep it as is, else change it to:

Suggested change
if: always()
if: success() || failure()

same remark for all steps with a if: always in the file

cf: https://docs.github.com/en/actions/writing-workflows/choosing-what-your-workflow-does/evaluate-expressions-in-workflows-and-actions#always

Causes the step to always execute, and returns true, even when canceled.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, this step must always run to upload the JSON result file indicating the failure. I'll make the modifications, thanks!

Copy link
Collaborator Author

@dlachaume dlachaume Nov 4, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated in this commit ✅ .

Copy link
Member

@jpraynaud jpraynaud left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 🚀

@@ -18,17 +19,42 @@ on:
default: "10.1.1"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
default: "10.1.1"
default: "10.1.2"

Copy link
Collaborator Author

@dlachaume dlachaume Nov 4, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated in this commit ✅ .

run: |
if [[ "${{ github.event_name }}" == "schedule" ]]; then
echo "total_releases=3" >> $GITHUB_OUTPUT
echo 'cardano_node_version=["10.1.1"]' >> $GITHUB_OUTPUT
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
echo 'cardano_node_version=["10.1.1"]' >> $GITHUB_OUTPUT
echo 'cardano_node_version=["10.1.2"]' >> $GITHUB_OUTPUT

Copy link
Collaborator Author

@dlachaume dlachaume Nov 4, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated in this commit ✅ .

@dlachaume dlachaume force-pushed the ensemble/2027/enhance-nightly-backward-compatibility-testing-workflow branch from f6e0eb7 to 17f8c3c Compare November 4, 2024 17:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Nightly backward compatibility testing with e2e tests
3 participants