MLOS icon indicating copy to clipboard operation
MLOS copied to clipboard

mlos_bench: first class scheduler support

Open bpkroth opened this issue 1 year ago • 2 comments

Right now we lack support for complex scheduling policies of future trials in mlos_bench.

This can be useful for:

  • repeating a trial across space (nodes, regions, etc.) and time in order to gain confidence in results and test for robustness to noise
  • manually "focusing" on a region of the config space
  • etc.

bpkroth avatar Jul 31 '23 21:07 bpkroth

Wrote some notes for this in https://github.com/microsoft/MLOS/issues/380#issuecomment-1832711391

bpkroth avatar Nov 30 '23 19:11 bpkroth

#676 adds some initial support for this

bpkroth avatar Feb 19 '24 16:02 bpkroth