substrate icon indicating copy to clipboard operation
substrate copied to clipboard

Create benchmark for the `system::set_code` instrisic

Open hirschenberger opened this issue 2 years ago • 5 comments

Benchmark system::set_code by timing uncompression and setting the kitchensink runtime, which is a rather big runtime. So it should be feasible to determine an upper bound.

fixes #13192

hirschenberger avatar Feb 13 '23 09:02 hirschenberger

I don't really know how to fix the current compiler error in the verify function. Thankful for any hint.

hirschenberger avatar Feb 13 '23 12:02 hirschenberger

You can use System::assert_last_event instead.

ggwpez avatar Feb 13 '23 13:02 ggwpez

It's hard to make the tests and benchmarks run without failure without too much conditional compilation

hirschenberger avatar Feb 18 '23 12:02 hirschenberger

@bkchr Is it ok to remove the verify arm from the benchmark to make it run without errors?

hirschenberger avatar Mar 02 '23 09:03 hirschenberger

@bkchr Is it ok to remove the verify arm from the benchmark to make it run without errors?

The benchmark test is failing because it misses an extension to be registered for the tests. @ggwpez can you show him how to register extensions for benchmark tests?

bkchr avatar Mar 11 '23 16:03 bkchr

Hey, is anyone still working on this? Due to the inactivity this issue has been automatically marked as stale. It will be closed if no further activity occurs. Thank you for your contributions.

stale[bot] avatar Apr 11 '23 02:04 stale[bot]

It seems to require a companion PR

hirschenberger avatar Apr 12 '23 07:04 hirschenberger

The polkadot companion CI seems to hang :-(

hirschenberger avatar Apr 13 '23 05:04 hirschenberger

bot bench $ pallet dev frame_system

ggwpez avatar Apr 13 '23 13:04 ggwpez

@ggwpez https://gitlab.parity.io/parity/mirrors/substrate/-/jobs/2680053 was started for your command "$PIPELINE_SCRIPTS_DIR/commands/bench/bench.sh" pallet dev frame_system. Check out https://gitlab.parity.io/parity/mirrors/substrate/-/pipelines?page=1&scope=all&username=group_605_bot to know what else is being executed currently.

Comment bot cancel 1-9279d82d-bc0c-4aba-bd64-d78675a00270 to cancel this command or bot cancel to cancel all commands in this pull request.

command-bot[bot] avatar Apr 13 '23 13:04 command-bot[bot]

@ggwpez Command "$PIPELINE_SCRIPTS_DIR/commands/bench/bench.sh" pallet dev frame_system has finished. Result: https://gitlab.parity.io/parity/mirrors/substrate/-/jobs/2680053 has finished. If any artifacts were generated, you can download them from https://gitlab.parity.io/parity/mirrors/substrate/-/jobs/2680053/artifacts/download.

command-bot[bot] avatar Apr 13 '23 14:04 command-bot[bot]

bot fmt

ggwpez avatar Apr 17 '23 19:04 ggwpez

@ggwpez Command "$PIPELINE_SCRIPTS_DIR/commands/fmt/fmt.sh" has finished. Result: https://gitlab.parity.io/parity/mirrors/substrate/-/jobs/2693079 has finished. If any artifacts were generated, you can download them from https://gitlab.parity.io/parity/mirrors/substrate/-/jobs/2693079/artifacts/download.

command-bot[bot] avatar Apr 17 '23 19:04 command-bot[bot]

/tip small

bkchr avatar Apr 21 '23 08:04 bkchr

@bkchr Contributor did not properly post their account address.

Make sure the pull request description has: "{network} address: {address}".

substrate-tip-bot[bot] avatar Apr 21 '23 08:04 substrate-tip-bot[bot]

/tip small

I added my address

hirschenberger avatar Apr 21 '23 08:04 hirschenberger

bot fmt

bkchr avatar Apr 21 '23 10:04 bkchr

@bkchr https://gitlab.parity.io/parity/mirrors/substrate/-/jobs/2712428 was started for your command "$PIPELINE_SCRIPTS_DIR/commands/fmt/fmt.sh". Check out https://gitlab.parity.io/parity/mirrors/substrate/-/pipelines?page=1&scope=all&username=group_605_bot to know what else is being executed currently.

Comment bot cancel 49-88735a74-51d0-4eab-89ef-345d30ffe768 to cancel this command or bot cancel to cancel all commands in this pull request.

command-bot[bot] avatar Apr 21 '23 10:04 command-bot[bot]

/tip small

bkchr avatar Apr 21 '23 10:04 bkchr

@bkchr A small tip was successfully submitted for hirschenberger (1ZApdbwrNnT1Hey4xeTAH6SZPDgbA9ZVftNuu9jTRbkc2Bg on polkadot).

https://polkadot.js.org/apps/?rpc=wss%3A%2F%2Frpc.polkadot.io#/treasury/tips tip

substrate-tip-bot[bot] avatar Apr 21 '23 10:04 substrate-tip-bot[bot]

@bkchr Command "$PIPELINE_SCRIPTS_DIR/commands/fmt/fmt.sh" has finished. Result: https://gitlab.parity.io/parity/mirrors/substrate/-/jobs/2712428 has finished. If any artifacts were generated, you can download them from https://gitlab.parity.io/parity/mirrors/substrate/-/jobs/2712428/artifacts/download.

command-bot[bot] avatar Apr 21 '23 10:04 command-bot[bot]

@hirschenberger the Cumulus companion seems to be missing

juangirini avatar May 08 '23 09:05 juangirini

bot rebase

ggwpez avatar May 11 '23 10:05 ggwpez

Rebased

bot merge

ggwpez avatar May 11 '23 10:05 ggwpez

Error: "Check reviews" status is not passing for https://github.com/paritytech/cumulus/pull/2547

bot merge

ggwpez avatar May 11 '23 10:05 ggwpez

Waiting for commit status.

Merge cancelled due to error. Error: Statuses failed for 719d26a0ead298a24486d3a3aa89ebe62d00f4f6

bot merge

KiChjang avatar May 11 '23 13:05 KiChjang