Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DONTMERGE: Lc/ci testing #1306

Closed
wants to merge 17 commits into from
Closed

DONTMERGE: Lc/ci testing #1306

wants to merge 17 commits into from

Conversation

locallycompact
Copy link
Contributor


  • CHANGELOG updated or not needed
  • Documentation updated or not needed
  • Haddocks updated or not needed
  • No new TODOs introduced or explained herafter

@locallycompact locallycompact force-pushed the lc/ci-testing branch 2 times, most recently from e20b879 to db8aacb Compare February 13, 2024 16:40
Copy link

Transactions Costs

Sizes and execution budgets for Hydra protocol transactions. Note that unlisted parameters are currently using arbitrary values and results are not fully deterministic and comparable to previous runs.

Metadata
Generated at 2024-02-13 17:27:40.911506886 UTC
Max. memory units 14000000
Max. CPU units 10000000000
Max. tx size (kB) 16384

Script summary

Name Hash Size (Bytes)
νInitial 985245919fcc6c0c5cd116023cd2c947c43e80dcbb5075fe12433fbb 4072
νCommit 7cb20fa71eb4c563ca283566ebe0aa65859d96c3f8cba35c52c181fd 2043
νHead 7a36661f5c15e9f1783aeaab890812c59b7286cbbc6de762d3110772 8816
μHead 8b111ac12274e46314769295a1c5dcab1d260096fc469fd698065463* 3851
  • The minting policy hash is only usable for comparison. As the script is parameterized, the actual script is unique per Head.

Cost of Init Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 4374 10.53 4.07 0.46
2 4576 12.68 4.88 0.49
3 4776 14.73 5.65 0.52
5 5177 19.31 7.39 0.59
10 6184 30.30 11.55 0.75
41 12418 99.17 37.66 1.77

Cost of Commit Transaction

This is using ada-only outputs for better comparability.

UTxO Tx size % max Mem % max CPU Min fee ₳
1 534 11.37 4.44 0.30
2 720 15.04 6.07 0.35
3 912 18.85 7.75 0.40
5 1285 26.90 11.27 0.51
10 2228 49.55 20.97 0.80
19 3902 99.43 41.75 1.43

Cost of CollectCom Transaction

Parties UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
1 56 479 21.78 8.51 0.41
2 114 590 33.13 13.07 0.54
3 171 704 44.86 17.89 0.67
4 227 810 60.40 24.22 0.85
5 282 920 76.45 30.84 1.03
6 337 1031 95.09 38.51 1.24

Cost of Close Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 543 16.68 7.67 0.36
2 671 18.09 8.98 0.39
3 760 18.95 9.91 0.41
5 1186 22.95 13.53 0.49
10 1796 29.13 19.57 0.61
50 8138 92.40 78.61 1.82

Cost of Contest Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 595 20.27 8.99 0.41
2 776 22.22 10.69 0.44
3 830 23.34 11.67 0.46
5 1182 27.35 15.09 0.53
10 1829 34.96 21.82 0.67
47 7374 98.24 76.71 1.82

Cost of Abort Transaction

Some variation because of random mixture of still initial and already committed outputs.

Parties Tx size % max Mem % max CPU Min fee ₳
1 4320 19.02 8.19 0.55
2 4375 27.33 11.67 0.65
3 4570 42.19 18.28 0.82
4 4570 55.96 24.23 0.98
5 4829 78.70 34.45 1.25

Cost of FanOut Transaction

Involves spending head output and burning head tokens. Uses ada-only UTxO for better comparability.

Parties UTxO UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
5 0 0 4206 7.42 3.10 0.42
5 1 57 4239 8.44 3.78 0.43
5 5 285 4376 13.77 7.00 0.50
5 10 569 4544 19.92 10.81 0.59
5 20 1137 4882 32.43 18.53 0.76
5 30 1711 5228 44.52 26.07 0.93
5 40 2275 5562 56.62 33.61 1.09
5 50 2843 5900 69.35 41.43 1.27
5 75 4271 6753 99.74 60.37 1.69

End-To-End Benchmark Results

This page is intended to collect the latest end-to-end benchmarks results produced by Hydra's Continuous Integration system from the latest master code.

Please take those results with a grain of salt as they are currently produced from very limited cloud VMs and not controlled hardware. Instead of focusing on the absolute results, the emphasis should be on relative results, eg. how the timings for a scenario evolve as the code changes.

Generated at 2024-02-13 17:28:30.036322615 UTC

Baseline Scenario

Number of nodes 3
Number of txs 9000
Avg. Confirmation Time (ms) 20.048004362
P99 36.64555724000003ms
P95 25.071378750000004ms
P50 18.878549ms
Number of Invalid txs 0

Baseline Scenario

Number of nodes 1
Number of txs 3000
Avg. Confirmation Time (ms) 5.493834198
P99 7.258823939999996ms
P95 6.419272599999998ms
P50 5.3440069999999995ms
Number of Invalid txs 0

@ch1bo ch1bo marked this pull request as draft February 14, 2024 07:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant