Skip to content

CI 📈: Add workflow for checking changes to weights in all runtimes#3129

Merged
RomarQ merged 3 commits intomasterfrom
pablo/ext-weight-diff-report
Feb 4, 2025
Merged

CI 📈: Add workflow for checking changes to weights in all runtimes#3129
RomarQ merged 3 commits intomasterfrom
pablo/ext-weight-diff-report

Conversation

@pLabarta
Copy link
Copy Markdown
Contributor

@pLabarta pLabarta commented Jan 9, 2025

What does it do?

This PR adds a new CI workflow which checks if files inside the weights folder changed for each runtime and generates a report of the changes sorted by Change %. It will only run for PRs that change the files generated by benchmarks.

Reports look like the following:

image

What important points reviewers should know?

Is there something left for follow-up PRs?

Currently, big changes might generate massive reports. If they end up being unreadable, this workflow could be changed to show only a summary in the PR discussion and upload full reports as artifacts or publish them as HTML pages.

What alternative implementations were considered?

Are there relevant PRs or issues in other repositories (Substrate, Polkadot, Frontier, Cumulus)?

What value does it bring to the blockchain users?

@pLabarta pLabarta requested review from a team as code owners January 9, 2025 18:28
@pLabarta pLabarta added B0-silent Changes should not be mentioned in any release notes ci Continuous Integration pipeline D2-notlive PR doesn't change runtime code (so can't be audited) labels Jan 9, 2025
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jan 9, 2025

WASM runtime size check:

Compared to target branch

Moonbase runtime: 2420 KB (no changes) 🚨

Moonbeam runtime: 2404 KB (no changes) 🚨

Moonriver runtime: 2392 KB (no changes) ✅

Compared to latest release (runtime-3401)

Moonbase runtime: 2420 KB (+388 KB compared to latest release) 🚨

Moonbeam runtime: 2404 KB (+392 KB compared to latest release) 🚨

Moonriver runtime: 2392 KB (+380 KB compared to latest release) ⚠️

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jan 9, 2025

Coverage Report

@@                       Coverage Diff                       @@
##           master   pablo/ext-weight-diff-report     +/-   ##
===============================================================
  Coverage   74.59%                         74.59%   0.00%     
  Files         380                            380             
  Lines       96029                          96029             
===============================================================
  Hits        71632                          71632             
  Misses      24397                          24397             
Files Changed Coverage

Coverage generated Tue Feb 4 17:30:16 UTC 2025

Comment thread .github/workflows/weight-diff-report.yml Outdated
Co-authored-by: Rodrigo Quelhas <22591718+RomarQ@users.noreply.github.com>
@RomarQ RomarQ self-requested a review February 4, 2025 16:06
@RomarQ RomarQ merged commit 08632a2 into master Feb 4, 2025
@RomarQ RomarQ deleted the pablo/ext-weight-diff-report branch February 4, 2025 19:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

B0-silent Changes should not be mentioned in any release notes ci Continuous Integration pipeline D2-notlive PR doesn't change runtime code (so can't be audited)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants