Ax icon indicating copy to clipboard operation
Ax copied to clipboard

Submitit ask-tell tutorial

Open mhavasi opened this issue 1 year ago • 4 comments

Adds a tutorial that shows how to use the AxClient to schedule jobs and tune parameters on a Slurm cluster via SubmitIt.

Code changes:

  1. The tutorial notebook
  2. Linking the tutorial notebook for the website. (index.js, tutorials.json)

Testing: Q: How can I make sure that this tutorial shows up correctly on the Ax doc site?

mhavasi avatar Jan 10 '24 18:01 mhavasi

Looks great! A couple notes (that I will just leave here since commenting on a .ipynb is annoying):

  • I can handle making sure this renders properly on the website. It's a little easier for me to do this once things have landed in fbsource so let's just get this in as is for now
  • Let's use exp_to_df(ax_client.experiment) instead of ax_client.generation_strategy.trials_as_df -- marginally better UX imo
  • Can we add a cell where we plot the response surface and optimization trace like we do here: https://ax.dev/tutorials/gpei_hartmann_service.html#6.-Plot-the-response-surface-and-optimization-trace ?
  • All the tutorials run locally during our testing, so can we comment out cluster='slurm' and replace with cluster='local' and a comment explaining that the cluster is set to local for testing purposes

mpolson64 avatar Jan 10 '24 20:01 mpolson64

One last thing: no need to write the covariance since the demo problem only has one metric

mpolson64 avatar Jan 10 '24 20:01 mpolson64

Thanks so much for the comments! I fixed the nits and I did another grammar pass.

mhavasi avatar Jan 11 '24 16:01 mhavasi

@mhavasi has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot avatar Jan 11 '24 18:01 facebook-github-bot

@mhavasi merged this pull request in facebook/Ax@894d392dd0a3c42f1f2758c9d5f4923af5a9ebc4.

facebook-github-bot avatar Jan 24 '24 22:01 facebook-github-bot

This is great, thanks for adding this!

Balandat avatar Feb 05 '24 05:02 Balandat