clusterfuzz icon indicating copy to clipboard operation
clusterfuzz copied to clipboard

Dynamic timeouts for engine based fuzzers, also analyze_task timeout should be higher (not 25 sec)

Open inferno-chromium opened this issue 5 years ago • 2 comments

Three bugs here:

  1. Too low timeout in google instance template. Now increased to 90 secs.
  2. Fix timeout argument during reproduction (upload testcases are not impacted as they dont have timeout arg at all).
  3. Use a fuzzing strategy for -timeout argument so that we try higher values than 25 sec for some runs.

inferno-chromium avatar Jul 31 '20 16:07 inferno-chromium

  1. and 2) are fixed.

inferno-chromium avatar Aug 03 '20 17:08 inferno-chromium

AFAICS, reproduction now uses TEST_TIMEOUT-5 which results in 60 seconds on OSS-Fuzz. If I specify a custom timeout in the .options file, for example 20 seconds, then a test case taking 40 seconds will initially result in a crash but the crash will be deemed non-reproducible. This also means that fixing the timeout won't be detected.

I think it would be better if reproduction used the timeout from the .options file, multiplied with a factor like 90%.

nwellnhof avatar Mar 01 '21 17:03 nwellnhof