vtr-verilog-to-routing icon indicating copy to clipboard operation
vtr-verilog-to-routing copied to clipboard

Published 20 hours ago • verified publisher icon verilog-to-routing

Implement multiple runs of vtr_flow to collect statistically significant data for runtime

Open HackerFoo opened this issue 3 years ago • 0 comments

Proposed Behaviour

Modify the vtr_flow scripts to allow running tests multiple times to compensate for variations in runtime on a single machine.

Current Behaviour

Currently, the vtr_flow scripts execute each test once.

Possible Solution

I suggest adding this as a flag, either specifying the number of times to run or the desired confidence.

Context

I have seen runtimes vary as much as 20% on cloud machines. This should help get more accurate measurements.

HackerFoo avatar Jan 11 '21 19:01 HackerFoo