fuzzbench icon indicating copy to clipboard operation
fuzzbench copied to clipboard

experiment request for fafuzz

Open Mart11n opened this issue 2 years ago • 11 comments

Experiment request for fafuzz, afl, aflpp and mopt

Mart11n avatar Aug 02 '23 13:08 Mart11n

Let me run this tomorrow.

jonathanmetzman avatar Aug 04 '23 03:08 jonathanmetzman

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2023-08-04-fafuzz --fuzzers fafuzz afl aflplusplus_407 mopt --benchmarks bloaty_fuzz_target curl_curl_fuzzer_http freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer jsoncpp_jsoncpp_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer mbedtls_fuzz_dtlsclient openssl_x509 systemd_fuzz-link-parser vorbis_decode_fuzzer zlib_zlib_uncompress_fuzzer re2_fuzzer sqlite3_ossfuzz woff2_convert_woff2ttf_fuzzer

jonathanmetzman avatar Aug 04 '23 11:08 jonathanmetzman

Looks like there's a bug with our experiments I got to fix first.

jonathanmetzman avatar Aug 04 '23 15:08 jonathanmetzman

Thank you 😁

Mart11n avatar Aug 06 '23 01:08 Mart11n

Hi, any update on this issue? Thank you.

Mart11n avatar Aug 14 '23 07:08 Mart11n

Hi, any update on this issue? Thank you.

Yes, I think it is fixed now. I will close&reopen this PR to apply the fix.

DonggeLiu avatar Aug 17 '23 03:08 DonggeLiu

The experiment cloud builder shows up in the CI now.

However, would you mind making a trivial modification to service/gcbrun_experiment.py? This will allow me to launch experiments in this PR before merging. Here is an example to add a dummy comment : ) Thanks!

DonggeLiu avatar Aug 17 '23 03:08 DonggeLiu

Hi, are these commits ready for the experiment? If not, please let me know. Thx for your work!

Mart11n avatar Aug 17 '23 14:08 Mart11n

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2023-10-05-fafuzz --fuzzers fafuzz afl aflplusplus_407 mopt aflpp_fa --benchmarks bloaty_fuzz_target curl_curl_fuzzer_http freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer jsoncpp_jsoncpp_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer mbedtls_fuzz_dtlsclient openssl_x509 systemd_fuzz-link-parser vorbis_decode_fuzzer zlib_zlib_uncompress_fuzzer re2_fuzzer sqlite3_ossfuzz woff2_convert_woff2ttf_fuzzer

DonggeLiu avatar Oct 05 '23 02:10 DonggeLiu

Hi @Mart11n, I am terribly sorry about the delay. I accidentally missed your last message. If this happens again, please always feel free to @ and ping us.

Experiment 2023-10-05-fafuzz data and results will be available later at: The experiment data. The experiment report.

DonggeLiu avatar Oct 05 '23 02:10 DonggeLiu

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2023-10-04-fafuzz --fuzzers fafuzz afl aflplusplus_407 mopt aflpp_fa --benchmarks bloaty_fuzz_target curl_curl_fuzzer_http freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer jsoncpp_jsoncpp_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer mbedtls_fuzz_dtlsclient openssl_x509 systemd_fuzz-link-parser vorbis_decode_fuzzer zlib_zlib_uncompress_fuzzer re2_fuzzer sqlite3_ossfuzz woff2_convert_woff2ttf_fuzzer

DonggeLiu avatar Oct 05 '23 02:10 DonggeLiu