fuzzbench icon indicating copy to clipboard operation
fuzzbench copied to clipboard

Published 20 hours ago • verified publisher icon google

Unique code coverage plots unreliable

Open oliverchang opened this issue 3 years ago • 1 comments

Unique code coverage plots are currently unreliably populated in the final FuzzBench report. Investigate why and fix this.

oliverchang avatar Sep 21 '22 05:09 oliverchang

@jonathanmetzman could you add a bit more details here on what needs to be fixed?

oliverchang avatar Sep 21 '22 05:09 oliverchang

This seems like it's related to https://github.com/google/fuzzbench/issues/1491 due to this condition:

https://github.com/google/fuzzbench/blob/669805b3b107c1b13c27c636a3e964ad929df0ba/experiment/dispatcher.py#L183

oliverchang avatar Sep 27 '22 05:09 oliverchang

Yeah basically the problem is we only generate the report once, after completion. This is fragile and in #1491 we see experiment measuring is prone to not completing.

jonathanmetzman avatar Sep 28 '22 10:09 jonathanmetzman