Skip to content

benches: Explicit benches relevant to #1860#1870

Merged
dhedey merged 3 commits intodevelopfrom
benches/various-sbor-benches
Aug 9, 2024
Merged

benches: Explicit benches relevant to #1860#1870
dhedey merged 3 commits intodevelopfrom
benches/various-sbor-benches

Conversation

@dhedey
Copy link
Copy Markdown
Contributor

@dhedey dhedey commented Aug 7, 2024

Summary

Various benches to gauge effectiveness of #1860

@dhedey dhedey changed the title benches: Explicit benches to stress benches: Explicit benches relevant to #1860 Aug 7, 2024
@github-actions
Copy link
Copy Markdown

github-actions Bot commented Aug 7, 2024

Phylum Report Link

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Aug 7, 2024

Docker tags
docker.io/radixdlt/private-scrypto-builder:f491cbf7cd

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Aug 7, 2024

Benchmark for f491cbf

Click to view benchmark
Test Base PR %
costing::bench_prepare_wasm 63.5±0.13ms 64.4±0.17ms +1.42%
costing::decode_encoded_i8_array_to_manifest_raw_value 19.5±0.08ms N/A N/A
costing::decode_encoded_i8_array_to_manifest_value 42.7±0.04ms N/A N/A
costing::decode_encoded_tuple_array_to_manifest_raw_value 63.3±0.18ms N/A N/A
costing::decode_encoded_tuple_array_to_manifest_value 121.4±1.09ms N/A N/A
costing::decode_encoded_u8_array_to_manifest_raw_value 32.2±0.08µs N/A N/A
costing::decode_encoded_u8_array_to_manifest_value 42.6±0.03ms N/A N/A
costing::decode_rpd_to_manifest_raw_value 12.5±0.03µs N/A N/A
costing::decode_rpd_to_manifest_value 10.7±0.03µs N/A N/A
costing::decode_sbor 10.8±0.02µs N/A N/A
costing::decode_sbor_bytes 29.2±0.02µs N/A N/A
costing::deserialize_wasm 1271.2±4.17µs 1270.0±5.26µs -0.09%
costing::execute_transaction_creating_big_vec_substates 716.8±13.69ms N/A N/A
costing::execute_transaction_reading_big_vec_substates 579.7±1.06ms N/A N/A
costing::instantiate_flash_loan 838.5±330.22µs 875.6±338.84µs +4.42%
costing::instantiate_radiswap 1123.2±1747.04µs 1147.5±1792.95µs +2.16%
costing::spin_loop 20.8±0.07ms 21.3±0.04ms +2.40%
costing::validate_sbor_payload 32.3±0.07µs 33.2±0.07µs +2.79%
costing::validate_sbor_payload_bytes 256.3±0.62ns 258.2±0.96ns +0.74%
costing::validate_secp256k1 76.8±0.26µs 76.7±0.09µs -0.13%
costing::validate_wasm 33.8±0.06ms 33.8±0.06ms 0.00%
decimal::add/0 8.4±0.00ns 8.4±0.00ns 0.00%
decimal::add/rust-native 9.9±0.01ns 9.9±0.01ns 0.00%
decimal::add/wasmi 220.4±0.25ns 226.0±9.22ns +2.54%
decimal::add/wasmi-call-native 2.1±0.00µs 2.1±0.01µs 0.00%
decimal::div/0 187.4±0.07ns 188.1±0.86ns +0.37%
decimal::from_string/0 159.6±0.40ns 159.4±0.37ns -0.13%
decimal::mul/0 150.7±0.42ns 150.0±0.67ns -0.46%
decimal::mul/rust-native 146.4±0.09ns 149.5±0.22ns +2.12%
decimal::mul/wasmi 12.1±0.09µs 12.2±0.08µs +0.83%
decimal::mul/wasmi-call-native 2.3±0.00µs 2.3±0.00µs 0.00%
decimal::pow/0 691.0±0.44ns 690.7±0.70ns -0.04%
decimal::pow/rust-native 663.9±0.67ns 664.7±0.50ns +0.12%
decimal::pow/wasmi 58.7±0.37µs 58.9±0.26µs +0.34%
decimal::pow/wasmi-call-native 2.5±0.00µs 2.5±0.00µs 0.00%
decimal::root/0 7.8±0.01µs 7.9±0.01µs +1.28%
decimal::sub/0 8.3±0.06ns 8.4±0.01ns +1.20%
decimal::to_string/0 438.6±0.56ns 433.1±0.35ns -1.25%
precise_decimal::add/0 8.8±0.01ns 8.8±0.03ns 0.00%
precise_decimal::add/rust-native 10.9±0.03ns 10.7±0.01ns -1.83%
precise_decimal::add/wasmi 277.6±0.96ns 280.1±0.57ns +0.90%
precise_decimal::add/wasmi-call-native 2.8±0.00µs 2.8±0.00µs 0.00%
precise_decimal::div/0 316.4±0.46ns 316.7±0.57ns +0.09%
precise_decimal::from_string/0 202.3±0.39ns 202.1±0.34ns -0.10%
precise_decimal::mul/0 361.5±0.21ns 361.7±0.58ns +0.06%
precise_decimal::mul/rust-native 319.4±0.26ns 320.4±0.38ns +0.31%
precise_decimal::mul/wasmi 36.1±0.31µs 35.3±0.13µs -2.22%
precise_decimal::mul/wasmi-call-native 3.2±0.01µs 3.2±0.01µs 0.00%
precise_decimal::pow/0 1949.5±1.99ns 1941.8±2.18ns -0.39%
precise_decimal::pow/rust-native 1526.6±2.14ns 1528.3±2.64ns +0.11%
precise_decimal::pow/wasmi 166.0±2.99µs 165.0±0.41µs -0.60%
precise_decimal::pow/wasmi-call-native 5.9±0.00µs 5.8±0.01µs -1.69%
precise_decimal::root/0 55.5±0.01µs 56.3±0.02µs +1.44%
precise_decimal::sub/0 9.0±0.11ns 9.0±0.13ns 0.00%
precise_decimal::to_string/0 702.5±0.80ns 697.0±2.48ns -0.78%
schema::validate_payload 380.4±0.93µs 381.5±1.50µs +0.29%
transaction::radiswap 5.2±0.02ms 5.3±0.02ms +1.92%
transaction::transfer 1943.5±3.60µs 1929.4±5.71µs -0.73%
transaction_processing::prepare 2.5±0.02ms 2.5±0.00ms 0.00%
transaction_processing::prepare_and_decompile 6.2±0.03ms 6.2±0.02ms 0.00%
transaction_processing::prepare_and_decompile_and_recompile 25.2±0.34ms 25.4±1.98ms +0.79%
transaction_validation::validate_manifest 42.8±0.05µs 42.9±0.04µs +0.23%
transaction_validation::verify_bls_2KB 1064.6±16.09µs 1002.2±8.35µs -5.86%
transaction_validation::verify_bls_32B 1038.1±32.11µs 1003.9±15.38µs -3.29%
transaction_validation::verify_ecdsa 74.6±0.07µs 74.6±0.09µs 0.00%
transaction_validation::verify_ed25519 55.1±0.11µs 55.2±0.06µs +0.18%

@dhedey dhedey marked this pull request as ready for review August 7, 2024 22:31
@dhedey dhedey merged commit dbcbea1 into develop Aug 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

2 participants