Feature wish: time graph over all benchmarks

[vanhauser-thc]

Every individual benchmark has a graph that shows the coverage from 0:15 until 23:00, e.g.

It would be nice to have a the same kind of graph for all targets combined. this would show fuzzers who are good at startup with not many seeds, those who who have a strong mid/end game strategy.

I dont think this is that helpful in the summary section so either in the summary to fold out or at the bottom?

[jonathanmetzman]

Every individual benchmark has a graph that shows the coverage from 0:15 until 23:00, e.g.

It would be nice to have a the same kind of graph for all targets combined. this would show fuzzers who are good at startup with not many seeds, those who who have a strong mid/end game strategy.

I dont think this is that helpful in the summary section so either in the summary to fold out or at the bottom?

I like the idea but it might require some thought how to do this. Right now the graph is a median/mean of trials. The naive approach would be to just combine trials from each benchmark, but that will make the graph hard to understand/interpret.

[vanhauser-thc]

I agree that this graph might not be easy to understand.

Thats why I propose to make it available but not prominently - either folded away, or at the bottom.

how to do the graph is I think easy - the average of the % coverage per benchmark target for that specific time the issue is rather that the benchmarks do not start at the time, so intermediate results are a bit weird - but that is true for the ranking as well, it fluctuates a lot. at the end of the experiment its fine though.