fuzzbench
fuzzbench copied to clipboard
google
FuzzBench - Fuzzer benchmarking as a service.
It's only needed for fuzzer integration. Instead the integration script can just clone OSS-Fuzz.
Sorry about the new PR. Reviewing would be easier this way :) PR is about generating 3 compressed CSV files recording the segment and function coverage over time. The CSV...
This would give earlier feedback to our users than the current approach of waiting for a report to appear. This is particularly true for private experiments.
During the halloweeen experiment and sometime a few months ago (when @inferno-chromium upgraded the size of the db instance), we had to manually intervene in the db because Fuzzbench could...
I ran the 4 fuzzers for 24hr period on few of the benchmarks. Under the experiment_data, it generated **corpus**, and **results** for all the trials. It generated **crashes** folder for...
E.g. run `make run-libfuzzer-matio_matio_fuzzer` You will see a crash ``` 8851: cov: 137 ft: 190 corp: 38 exec/s 110 oom/timeout/crash: 7/0/0 time: 36s job: 8 dft_time: 0 No such file...
This issue tracks switching to the queue based measurer. This will make measuring horizontally scalable, making experiments shorter, cheaper and results more realtime. It is also necessary for the new...
This is bad because it makes noop builds take two minutes (installing all packages we need takes 1:30).
Would be cool to have an API that fuzzers can use to report stats to FuzzBench. Fuzzers should modify their code to enable more insightful evaluations (like https://hexgolems.com/2020/08/on-measuring-and-visualizing-fuzzer-performance/) like coverage...
We should have some documentation on how to create/do migrations for developers. We should also have some documentation on how to run them for users of fuzzbench. (Maybe fuzzbench should...