fuzzbench
fuzzbench copied to clipboard
Should `np.median` be replaced with `np.mean` for plotting 'Mean code coverage growth over time'?
I noticed that when plotting the 'Mean code coverage growth over time' graph, np.median is used as the estimator (L166):
https://github.com/google/fuzzbench/blob/2920e74f192e1b7add95eb5ac49b0e0049d1c876/analysis/plotting.py#L159-L171
Shouldn't np.mean be used instead? For example, the order of this graph uses benchmark_rank_by_mean:
https://github.com/google/fuzzbench/blob/2920e74f192e1b7add95eb5ac49b0e0049d1c876/analysis/plotting.py#L156
Is there a specific reason for using np.median here, or am I missing something?
Looking forward to your insights. Thanks.