Matthew Seal
Matthew Seal
The `-y` option allows for json/yaml input which includes expanded types. There is some oddities with literal eval in older versions of python (e.g. '1+1' is valid in python <...
Sort of. Papermill support basic json data types being transferable because it's easy to translate them to the underlying notebook execution process by translating the data to code in the...
Possibly under specialized circumstances, but remember that the kernel is not guaranteed to be the same python version with the same dependencies available. Most pickled objects don't work across python...
I believe you can use a [configuration file for S3 to set the assumed role](https://docs.aws.amazon.com/cli/latest/userguide/cli-configure-role.html). You can set the output_notebook path to a local file to get the contents locally...
1) would work, but as you hinted you'd need to monitor the [tasks for their exit codes](https://www.ibm.com/support/knowledgecenter/en/SSETD4_9.1.3/lsf_admin/job_exit_codes_lsf.html). The papermill cli will return non-zero for failed notebooks. You wouldn't need a...
That Dask pattern could work depending on what you're doing. Though usually Dask is used more to distribute a function across many executor nodes against subsets of rows. If you're...
Sorry for the late response, been very busy. We work with systems that generally abstract job status management and react to state changes with our coded responses. This is one...
This would be great!
@rgbkrk Has the clearest knowledge of the origin story, but it's a play on needing a papermill to create all the paper for your notebooks. Also great meme use :)
I agree with those suggestions. I think the clear docs on any kwargs that might be popped and reassigned is a reasonable trade-off. I also like the **dict(kwargs...) pattern proposed...