Oliver Chang

Results 621 comments of Oliver Chang

Can we use https://docs.python.org/3/library/concurrent.futures.html#concurrent.futures.ProcessPoolExecutor instead to make the code paths more consistent for the process case?

@DavidKorczynski @DonggeLiu WDYT?

> Am I correct that the `driver.py` is effectively orchestrating core operations like prompt_generation, target_generator, and target_evalutor, while `run_all_experiments.py` becomes a wrapper that invokes it? That's right!

> The above sentence confused me slightly, and this may be a similar question to @DonggeLiu's -- How about a scenario where the custom prompt generation want to have some...

This will rely on https://github.com/google/oss-fuzz-gen/issues/10

(Part of https://github.com/ossf/fuzz-introspector)

CC @DavidKorczynski @AdamKorcz

Once we get regular full experiments up and running, it might also be helpful to find benchmarks that constantly flip flop between building and non-building.

@vitorguidi this would be a good upgrade to do once the Python upgrade sticks.