papermill icon indicating copy to clipboard operation
papermill copied to clipboard

Does papermill allow user to input multiple parameters and combine selected cells as an output?

Open xiaoyaoyang opened this issue 6 years ago • 3 comments

Maybe this is not the perfect use case for the Papermill. The idea is similar to parameters tuning, where we would like to input a set of parameters and out put set of result.. what is the best practice for papermill regarding this?

xiaoyaoyang avatar Jul 20 '19 06:07 xiaoyaoyang

do you mean using --prepare-only / --prepare-execute?

casperdcl avatar Jul 20 '19 09:07 casperdcl

@casperdcl Thanks for the reply, I don't think so though.. I read the docs it says

Flag for outputting the notebook without execution, but with parameters applied. Can you kindly explain what it means..? it will just insert the inject-param cell and output the notebook?

Let's say I have 20 potential parameters, and for each parameters I would like to generate results (in this case, would be notebook since I don't think papermill could output other format). Next, I would need to go to those 20 notebooks (each one contains charts, results, validations etc) and figure out which one is the best (thus choose the parameter).

Question: is there a way to combine 20 notebook results with papermill? is this a good use case for papermill?

xiaoyaoyang avatar Jul 21 '19 02:07 xiaoyaoyang

I'm not sure I follow the questions perfectly, but you may be describing executing 20 notebooks with papermill and then wanting to evaluate the results. In that case I'd suggest looking into https://github.com/nteract/scrapbook to programatically generate outcomes you can compare. Then you could save a best-fit result for each parameterization and evaluate how the runs compare.

MSeal avatar Jul 22 '19 02:07 MSeal