HotShot icon indicating copy to clipboard operation
HotShot copied to clipboard

[Auto Benchmarks] - Faster auto benchmarking by re-examine the time of each run

Open dailinsubjam opened this issue 1 year ago • 0 comments

What is this task and why do we need to work on it?

This is to make the auto benchmarking faster by changing the sleep time in the scripts. Now we have to sleep for enough time to wait each run complete and then shut down all nodes by ecs scale back to 0. The way to measure the sleep time now is to calculate a formula correlated to total_nodes, rounds, transaction_size and transactions_per_round. However this is far more longer than it actually needed.

What work will need to be done to complete this task?

  • re-examine the formula we want for a more precise estimation of elapsed time for each run
  • would be best if we can have a signal when the runs are finished, so that we shut down all the nodes right after the benchmark results are output.

Are there any other details to include?

No response

What are the acceptance criteria to close this issue?

We could finish a bunch of runs with different parameters we want within 8 hours (basically like if we start it at night, we can see the results next morning when wake up).

Branch work will be merged to (if not the default branch)

No response

dailinsubjam avatar May 17 '24 23:05 dailinsubjam