fuzzbench icon indicating copy to clipboard operation
fuzzbench copied to clipboard

Should `np.median` be replaced with `np.mean` for plotting 'Mean code coverage growth over time'?

Open leonasdev opened this issue 10 months ago • 0 comments

I noticed that when plotting the 'Mean code coverage growth over time' graph, np.median is used as the estimator (L166): https://github.com/google/fuzzbench/blob/2920e74f192e1b7add95eb5ac49b0e0049d1c876/analysis/plotting.py#L159-L171

Shouldn't np.mean be used instead? For example, the order of this graph uses benchmark_rank_by_mean: https://github.com/google/fuzzbench/blob/2920e74f192e1b7add95eb5ac49b0e0049d1c876/analysis/plotting.py#L156

Is there a specific reason for using np.median here, or am I missing something?

Looking forward to your insights. Thanks.

leonasdev avatar Feb 06 '25 02:02 leonasdev