flow-go icon indicating copy to clipboard operation
flow-go copied to clipboard

Update to cadence v0.25.0

Open SupunS opened this issue 3 years ago • 1 comments

Updating flow-go master branch with the Cadence version v0.25.0

SupunS avatar Aug 03 '22 17:08 SupunS

FVM Benchstat comparison

This branch with compared with the base branch onflow:master commit a8c05ee966c559feb1cefecde38a05a404b89ec8

The command (for i in {1..N}; do go test ./fvm --bench . --tags relic -shuffle=on --benchmem --run ^$; done) was used.

Bench tests were run a total of 10 times on each branch.

Collapsed results for better readability

old.txtnew.txt
time/opdelta
RuntimeNFTBatchTransfer-2101ms ± 3%108ms ± 8%+7.26%(p=0.000 n=10+10)
RuntimeTransaction/convert_int_to_string_and_concatenate_it-227.4ms ± 4%28.9ms ± 9%+5.59%(p=0.008 n=9+10)
RuntimeTransaction/borrow_array_from_storage-2112ms ± 4%117ms ± 3%+4.63%(p=0.001 n=10+9)
RuntimeTransaction/get_signer_receiver-242.5ms ± 4%44.3ms ± 6%+4.24%(p=0.004 n=10+10)
RuntimeTransaction/call_empty_contract_function-227.6ms ± 4%28.6ms ± 7%+3.70%(p=0.011 n=10+10)
RuntimeTransaction/emit_event-241.3ms ± 5%42.7ms ± 6%+3.59%(p=0.019 n=10+10)
RuntimeTransaction/load_and_save_empty_string_on_signers_address-231.6ms ± 4%32.7ms ± 2%+3.54%(p=0.006 n=10+9)
RuntimeTransaction/get_signer_vault-232.3ms ± 4%33.4ms ± 7%+3.46%(p=0.023 n=10+10)
RuntimeTransaction/create_new_account-2915ms ± 4%942ms ± 2%+2.99%(p=0.043 n=10+9)
RuntimeTransaction/load_and_save_long_string_on_signers_address-269.9ms ± 4%72.0ms ± 2%+2.95%(p=0.043 n=10+9)
RuntimeTransaction/copy_array_from_storage-2116ms ± 5%119ms ± 5%+2.92%(p=0.035 n=10+10)
RuntimeTransaction/get_public_account-227.6ms ± 4%28.4ms ± 3%+2.84%(p=0.040 n=9+9)
RuntimeTransaction/reference_tx-224.1ms ± 8%24.2ms ± 3%~(p=0.829 n=10+8)
RuntimeTransaction/convert_int_to_string-226.0ms ± 6%26.4ms ± 4%~(p=0.863 n=9+9)
RuntimeTransaction/get_signer_address-224.8ms ± 6%25.5ms ± 5%~(p=0.133 n=10+9)
RuntimeTransaction/get_account_and_get_balance-2505ms ± 4%521ms ± 5%~(p=0.089 n=10+10)
RuntimeTransaction/get_account_and_get_available_balance-2411ms ± 4%423ms ± 6%~(p=0.190 n=10+10)
RuntimeTransaction/get_account_and_get_storage_used-232.0ms ± 4%33.0ms ± 9%~(p=0.123 n=10+10)
RuntimeTransaction/get_account_and_get_storage_capacity-2376ms ± 4%385ms ± 4%~(p=0.113 n=10+9)
RuntimeTransaction/transfer_tokens-2184ms ± 3%188ms ± 2%~(p=0.053 n=10+9)
 
computationdelta
RuntimeTransaction/reference_tx-2202 ± 0%202 ± 0%~(all equal)
RuntimeTransaction/convert_int_to_string-2402 ± 0%402 ± 0%~(all equal)
RuntimeTransaction/convert_int_to_string_and_concatenate_it-2502 ± 0%502 ± 0%~(all equal)
RuntimeTransaction/get_signer_address-2302 ± 0%302 ± 0%~(all equal)
RuntimeTransaction/get_public_account-2402 ± 0%402 ± 0%~(all equal)
RuntimeTransaction/get_account_and_get_balance-21.00k ± 0%1.00k ± 0%~(all equal)
RuntimeTransaction/get_account_and_get_available_balance-22.60k ± 0%2.60k ± 0%~(all equal)
RuntimeTransaction/get_account_and_get_storage_used-2402 ± 0%402 ± 0%~(all equal)
RuntimeTransaction/get_account_and_get_storage_capacity-21.30k ± 0%1.30k ± 0%~(all equal)
RuntimeTransaction/get_signer_vault-2402 ± 0%402 ± 0%~(all equal)
RuntimeTransaction/get_signer_receiver-2602 ± 0%602 ± 0%~(all equal)
RuntimeTransaction/transfer_tokens-23.50k ± 0%3.50k ± 0%~(all equal)
RuntimeTransaction/load_and_save_empty_string_on_signers_address-2602 ± 0%602 ± 0%~(all equal)
RuntimeTransaction/load_and_save_long_string_on_signers_address-2602 ± 0%602 ± 0%~(all equal)
RuntimeTransaction/create_new_account-2202 ± 0%202 ± 0%~(all equal)
RuntimeTransaction/call_empty_contract_function-2402 ± 0%402 ± 0%~(all equal)
RuntimeTransaction/emit_event-2602 ± 0%602 ± 0%~(all equal)
RuntimeTransaction/borrow_array_from_storage-22.60k ± 0%2.60k ± 0%~(all equal)
RuntimeTransaction/copy_array_from_storage-22.60k ± 0%2.60k ± 0%~(all equal)
 
interactionsdelta
RuntimeTransaction/reference_tx-247.7k ± 0%47.7k ± 0%~(all equal)
RuntimeTransaction/convert_int_to_string-247.7k ± 0%47.7k ± 0%~(all equal)
RuntimeTransaction/convert_int_to_string_and_concatenate_it-247.7k ± 0%47.7k ± 0%~(all equal)
RuntimeTransaction/get_signer_address-247.7k ± 0%47.7k ± 0%~(all equal)
RuntimeTransaction/get_public_account-247.7k ± 0%47.7k ± 0%~(all equal)
RuntimeTransaction/get_account_and_get_balance-216.8M ± 0%16.8M ± 0%~(all equal)
RuntimeTransaction/get_account_and_get_available_balance-25.28M ± 0%5.28M ± 0%~(all equal)
RuntimeTransaction/get_account_and_get_storage_used-251.3k ± 0%51.3k ± 0%~(all equal)
RuntimeTransaction/get_account_and_get_storage_capacity-25.28M ± 0%5.28M ± 0%~(all equal)
RuntimeTransaction/get_signer_vault-248.0k ± 0%48.0k ± 0%~(all equal)
RuntimeTransaction/get_signer_receiver-248.3k ± 0%48.3k ± 0%~(all equal)
RuntimeTransaction/transfer_tokens-249.1k ± 0%49.1k ± 0%~(all equal)
RuntimeTransaction/load_and_save_empty_string_on_signers_address-248.1k ± 0%48.1k ± 0%~(all equal)
RuntimeTransaction/load_and_save_long_string_on_signers_address-253.0k ± 0%53.0k ± 0%~(all equal)
RuntimeTransaction/create_new_account-28.53M ± 0%8.53M ± 0%~(all equal)
RuntimeTransaction/call_empty_contract_function-247.9k ± 0%47.9k ± 0%~(all equal)
RuntimeTransaction/emit_event-247.9k ± 0%47.9k ± 0%~(all equal)
RuntimeTransaction/borrow_array_from_storage-253.1k ± 0%53.1k ± 0%~(all equal)
RuntimeTransaction/copy_array_from_storage-253.1k ± 0%53.1k ± 0%~(all equal)
 
alloc/opdelta
RuntimeTransaction/load_and_save_long_string_on_signers_address-223.7MB ± 0%23.8MB ± 0%+0.26%(p=0.005 n=10+10)
RuntimeTransaction/reference_tx-27.59MB ± 0%7.61MB ± 0%~(p=0.083 n=8+10)
RuntimeTransaction/convert_int_to_string-28.08MB ± 1%8.07MB ± 0%~(p=0.684 n=10+10)
RuntimeTransaction/convert_int_to_string_and_concatenate_it-28.63MB ± 0%8.64MB ± 0%~(p=0.074 n=8+9)
RuntimeTransaction/get_signer_address-27.83MB ± 0%7.85MB ± 0%~(p=0.105 n=10+10)
RuntimeTransaction/get_public_account-29.29MB ± 1%9.26MB ± 0%~(p=0.063 n=10+10)
RuntimeTransaction/get_account_and_get_balance-2195MB ± 0%195MB ± 0%~(p=1.000 n=10+10)
RuntimeTransaction/get_account_and_get_available_balance-2145MB ± 0%145MB ± 0%~(p=0.436 n=10+10)
RuntimeTransaction/get_account_and_get_storage_used-210.5MB ± 1%10.5MB ± 1%~(p=0.796 n=10+10)
RuntimeTransaction/get_account_and_get_storage_capacity-2140MB ± 0%140MB ± 0%~(p=0.218 n=10+10)
RuntimeTransaction/get_signer_vault-29.80MB ± 0%9.81MB ± 1%~(p=0.604 n=9+10)
RuntimeTransaction/get_signer_receiver-213.6MB ± 1%13.6MB ± 1%~(p=0.190 n=10+10)
RuntimeTransaction/transfer_tokens-248.0MB ± 0%48.0MB ± 0%~(p=0.247 n=10+10)
RuntimeTransaction/load_and_save_empty_string_on_signers_address-29.26MB ± 0%9.27MB ± 0%~(p=0.165 n=10+10)
RuntimeTransaction/create_new_account-2216MB ± 0%216MB ± 0%~(p=0.971 n=10+10)
RuntimeTransaction/call_empty_contract_function-28.53MB ± 0%8.53MB ± 0%~(p=0.743 n=9+8)
RuntimeTransaction/emit_event-212.6MB ± 0%12.6MB ± 0%~(p=0.796 n=10+10)
RuntimeTransaction/borrow_array_from_storage-233.9MB ± 0%33.9MB ± 0%~(p=0.549 n=9+10)
RuntimeTransaction/copy_array_from_storage-245.1MB ± 0%45.0MB ± 0%~(p=0.436 n=10+10)
RuntimeNFTBatchTransfer-224.4MB ± 0%24.4MB ± 0%~(p=0.143 n=10+10)
 
allocs/opdelta
RuntimeTransaction/reference_tx-2122k ± 0%122k ± 0%~(p=0.985 n=10+10)
RuntimeTransaction/convert_int_to_string-2137k ± 0%137k ± 0%~(p=0.534 n=10+9)
RuntimeTransaction/convert_int_to_string_and_concatenate_it-2151k ± 0%151k ± 0%~(p=0.616 n=9+10)
RuntimeTransaction/get_signer_address-2128k ± 0%128k ± 0%~(p=0.753 n=10+10)
RuntimeTransaction/get_public_account-2159k ± 0%159k ± 0%~(p=0.983 n=10+9)
RuntimeTransaction/get_account_and_get_balance-23.17M ± 0%3.17M ± 0%~(p=0.095 n=10+9)
RuntimeTransaction/get_account_and_get_available_balance-22.55M ± 0%2.55M ± 0%~(p=0.342 n=10+10)
RuntimeTransaction/get_account_and_get_storage_used-2181k ± 0%181k ± 0%~(p=0.590 n=10+10)
RuntimeTransaction/get_account_and_get_storage_capacity-22.39M ± 0%2.39M ± 0%~(p=0.535 n=10+9)
RuntimeTransaction/get_signer_vault-2174k ± 0%174k ± 0%~(p=0.732 n=10+10)
RuntimeTransaction/get_signer_receiver-2263k ± 0%263k ± 0%~(p=0.118 n=10+10)
RuntimeTransaction/transfer_tokens-21.03M ± 0%1.03M ± 0%~(p=0.529 n=10+10)
RuntimeTransaction/load_and_save_empty_string_on_signers_address-2173k ± 0%173k ± 0%~(p=0.324 n=10+10)
RuntimeTransaction/load_and_save_long_string_on_signers_address-2269k ± 0%269k ± 0%~(p=0.251 n=10+9)
RuntimeTransaction/create_new_account-23.58M ± 0%3.58M ± 0%~(p=0.085 n=10+10)
RuntimeTransaction/call_empty_contract_function-2139k ± 0%139k ± 0%~(p=0.988 n=10+10)
RuntimeTransaction/emit_event-2184k ± 0%184k ± 0%~(p=0.794 n=9+10)
RuntimeTransaction/borrow_array_from_storage-2412k ± 0%412k ± 0%~(p=0.072 n=10+10)
RuntimeTransaction/copy_array_from_storage-2368k ± 0%368k ± 0%~(p=0.188 n=9+10)
RuntimeNFTBatchTransfer-2332k ± 0%332k ± 0%~(p=0.127 n=10+10)
 

github-actions[bot] avatar Aug 03 '22 17:08 github-actions[bot]

no longer needed (@SupunS FYI)

j1010001 avatar Sep 08 '22 14:09 j1010001