Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Save space on the GitHub runners by not building the devShells #1705

Merged
merged 1 commit into from
Oct 11, 2024

Conversation

noonio
Copy link
Contributor

@noonio noonio commented Oct 11, 2024

Reverts part of 1a74b59#diff-fb5c295cef0d8c42d829f58e5ec19920f741526206f7601876d6412d394acc35R107 because there isn't enough space on the GitHub self-hosted runners :(

@noonio noonio requested a review from v0d1ch October 11, 2024 12:45
Copy link

Transaction costs

Sizes and execution budgets for Hydra protocol transactions. Note that unlisted parameters are currently using arbitrary values and results are not fully deterministic and comparable to previous runs.

Metadata
Generated at 2024-10-11 12:47:11.880773712 UTC
Max. memory units 14000000
Max. CPU units 10000000000
Max. tx size (kB) 16384

Script summary

Name Hash Size (Bytes)
νInitial b512161ccb0652d7e9a0b540e4a3c808f73d6558a4bcabf374d85880 3969
νCommit ea444d37d226e71eef73ac78d149750da977feb588900135bf9e8221 692
νHead 2253ddd95837c7aacc8635a971caaea743434152dd8dd2849bdf4162 10797
μHead 4d648ca239040b0e87901835aa11423e7aa3bd947ce6befe7db1bae8* 4508
νDeposit 1a011f23b139a6426767026bde10319546485d553219a5848cdac4e5 2993
  • The minting policy hash is only usable for comparison. As the script is parameterized, the actual script is unique per head.

Init transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 5097 5.71 2.25 0.44
2 5298 7.26 2.87 0.46
3 5496 8.37 3.30 0.48
5 5902 11.45 4.53 0.54
10 6906 18.11 7.16 0.65
57 16356 83.00 32.84 1.78

Commit transaction costs

This uses ada-only outputs for better comparability.

UTxO Tx size % max Mem % max CPU Min fee ₳
1 569 10.84 4.26 0.29
2 757 14.31 5.80 0.34
3 944 17.92 7.39 0.39
5 1323 25.56 10.73 0.49
10 2262 47.11 19.97 0.77
19 3940 94.71 39.81 1.38

CollectCom transaction costs

Parties UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
1 57 560 20.58 7.85 0.40
2 113 671 27.03 10.31 0.47
3 170 782 35.40 13.49 0.57
4 226 893 44.15 16.78 0.67
5 283 1004 55.17 20.95 0.79
6 338 1116 67.20 25.47 0.93
7 394 1227 73.03 27.70 0.99
8 449 1338 88.48 33.50 1.17
9 505 1449 86.74 32.99 1.15
10 560 1560 96.99 36.85 1.27

Cost of Decrement Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 647 18.68 8.17 0.39
2 723 18.46 8.82 0.39
3 962 22.35 11.14 0.45
5 1120 22.68 12.79 0.48
10 1974 32.83 20.57 0.65
48 7615 94.74 74.04 1.78

Close transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 648 20.87 9.33 0.41
2 738 21.93 10.44 0.44
3 1054 24.56 12.91 0.49
5 1290 27.38 15.73 0.54
10 1950 34.63 22.94 0.68
50 7825 97.06 84.35 1.89

Contest transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 630 26.36 11.13 0.47
2 855 28.94 13.35 0.52
3 1017 30.72 14.95 0.55
5 1328 34.72 18.41 0.62
10 2042 44.07 26.69 0.79
39 6503 99.97 75.61 1.79

Abort transaction costs

There is some variation due to the random mixture of initial and already committed outputs.

Parties Tx size % max Mem % max CPU Min fee ₳
1 4894 12.57 5.13 0.50
2 5053 21.41 9.12 0.61
3 5312 28.89 12.57 0.71
4 5336 34.98 15.13 0.78
5 5467 41.86 18.11 0.86
6 5573 46.27 19.98 0.91
7 5701 52.90 22.88 0.99
8 5892 57.41 24.90 1.05
9 6128 71.37 31.24 1.22
10 6215 73.48 32.00 1.25
11 6280 80.31 34.79 1.33
12 6636 93.71 41.19 1.50
13 6515 93.97 40.78 1.49

FanOut transaction costs

Involves spending head output and burning head tokens. Uses ada-only UTxO for better comparability.

Parties UTxO UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
10 0 0 5089 10.27 4.30 0.49
10 1 57 5123 10.76 4.73 0.50
10 5 285 5259 15.83 7.79 0.57
10 10 569 5428 22.06 11.57 0.65
10 20 1139 5768 32.96 18.47 0.80
10 30 1708 6109 45.24 25.96 0.97
10 40 2278 6450 56.74 33.12 1.13
10 50 2847 6789 68.44 40.36 1.29
10 76 4326 7669 99.36 59.43 1.72

End-to-end benchmark results

This page is intended to collect the latest end-to-end benchmark results produced by Hydra's continuous integration (CI) system from the latest master code.

Please note that these results are approximate as they are currently produced from limited cloud VMs and not controlled hardware. Rather than focusing on the absolute results, the emphasis should be on relative results, such as how the timings for a scenario evolve as the code changes.

Generated at 2024-10-11 12:48:55.334948424 UTC

Baseline Scenario

Number of nodes 1
Number of txs 300
Avg. Confirmation Time (ms) 4.102628313
P99 8.920471599999987ms
P95 5.0682506499999995ms
P50 3.900327ms
Number of Invalid txs 0

Three local nodes

Number of nodes 3
Number of txs 900
Avg. Confirmation Time (ms) 24.193575718
P99 118.91417432ms
P95 31.5023174ms
P50 20.763056499999998ms
Number of Invalid txs 0

Copy link

Test Results

544 tests  ±0   538 ✅ ±0   26m 14s ⏱️ -34s
162 suites ±0     6 💤 ±0 
  7 files   ±0     0 ❌ ±0 

Results for commit a66f1fc. ± Comparison against base commit d18e15c.

@v0d1ch v0d1ch added this pull request to the merge queue Oct 11, 2024
Merged via the queue into master with commit d8c0a49 Oct 11, 2024
28 checks passed
@v0d1ch v0d1ch deleted the dont-build-devShells-to-save-space branch October 11, 2024 13:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants