iree icon indicating copy to clipboard operation
iree copied to clipboard

Stablize compilation time measurement in benchmarks

Open antiagainst opened this issue 2 years ago • 1 comments

Right now we measure the compilation time for compiling various models. Though the numbers reported can vary a lot. For example, this one ranges from 60s to 140s; similarly for CPU. With such a level of noisiness we cannot draw any meaningful information out of it and it's actually a distraction. We'd need to figure out ways to make the numbers more stable.

antiagainst avatar Jan 20 '23 21:01 antiagainst

Unassigned myself as I'm not working on this currently

pzread avatar May 01 '24 17:05 pzread