fuzzbench

fuzzbench copied to clipboard

Support running FuzzBench without Google Cloud

7

Local experiments are currently not truly local because they depend on Google Cloud Storage (GCS). We should break this dependency. We use gsutil which has bash-like commands for managing files...

jonathanmetzman

Aggregate log plots for coverage growth.

1

Idea from Marcel

inferno-chromium

inferno-chromium

Verify that clang cov and sancov produce similar results on the same experiment

3

You might need to do some hacking to make sure it downloads the right coverage binaries, but you can probably do this by running measurer.py standalone and deleting (save them...

jonathanmetzman

lcms benchmark -- seed profile seems invalid

3

Hi, I am working on a few more input models for the input-structure aware fuzzer AFLSmart and I figure out that the single seed for little-cms library seems invalid. I...

thuanpv

preemptible_runners should be true by default

1

Once preemptibles functionality is stablized, need to turn them off by default. Other users shouldn't pay more if they can't find this setting.

inferno-chromium

Move benchmark git checkout commands to Dockerfile, just after clone for readability

2

inferno-chromium

KLEE fuzzer integration meta bug

1

inferno-chromium

Variance in FuzzBench trials with same random seed

31

@vanhauser-thc wrote [here](https://github.com/google/fuzzbench/issues/654#issuecomment-672845457): >the experiment has started => https://www.fuzzbench.com/reports/2020-08-12/index.html and we can see the aflplusplus_same1 .. aflplusplus_same3 instances to have quite a different coverage. >for several benchmarks this will even...

jonathanmetzman

For example: - "dictionary" category would compare only fuzzers with dictionary support on benchmarks with dictionaries - "structure aware fuzzing" category would compare only fuzzers with grammar/model support on on...

lszekeres