fuzzbench
fuzzbench copied to clipboard
google
SBFT'24 Competition - No mutation testing
@Alan32Liu could you try another coverage experiment with this branch?
/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name sbft-standard-cov-01-17 --fuzzers libafl libfuzzer mystique pastis bandfuzz tunefuzz fox
Oh scratch my comment in the other PR. Will run this now
@Alan32Liu could you try another coverage experiment with this branch?
/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name sbft-standard-cov-01-17 --fuzzers libafl libfuzzer mystique pastis bandfuzz tunefuzz fox
ops, did you forget to make the dummy change to trigger exp? : ) Unfortunately I don't have the permission to add it to your branch.
/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name sbft-standard-cov-01-17 --fuzzers libafl libfuzzer mystique pastis bandfuzz tunefuzz fox
@Alan32Liu, done, it was in the sbft branch that I removed ...
It also seems that we do not have a report for pastis, so we could skip that fuzzer to save some time in the eval.
/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name sbft-standard-cov-01-18 --fuzzers libafl libfuzzer mystique bandfuzz tunefuzz fox
Experiment sbft-standard-cov-01-17 data and results will be available later at:
The experiment data.
The experiment report.
Ah you were faster, how long would you expect this experiment to take?
1-2 days? I will need to re-run the command because the last one was somehow interrupted.
/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name sbft-standard-cov-01-18 --fuzzers libafl libfuzzer mystique bandfuzz tunefuzz fox
/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name sbft-standard-cov-01-18 --fuzzers libafl libfuzzer mystique pastis bandfuzz tunefuzz fox
Experiment sbft-standard-cov-01-18 data and results will be available later at:
The experiment data.
The experiment report.
/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name sbft-standard-cov-01-18-p --fuzzers libafl libfuzzer mystique pastis bandfuzz tunefuzz fox
Experiment sbft-standard-cov-01-18-p data and results will be available later at:
The experiment data.
The experiment report.
@Alan32Liu we had one final commit... Could you start the experiment again? Also did something go wrong with the experiment, I don't see any build directories?
/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name sbft-standard-cov-01-19-p --fuzzers libafl libfuzzer mystique pastis bandfuzz tunefuzz fox
@Alan32Liu can you post the link to the results of the experiment as well? 🙂
This is so strange: The experiment was not requested.
This also happened on the previous 2 exps. Let me try again.
/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name sbft-standard-cov-01-20 --fuzzers libafl libfuzzer mystique pastis bandfuzz tunefuzz fox
Pretty sure it is working this time!
Experiment sbft-standard-cov-01-20 data and results will be available later at:
The experiment data.
The experiment report.
OR
The experiment report.