papermill
papermill copied to clipboard
Repo2Docker Engine
Enable a repo2docker engine which pull a requirements file and launches docker to execute the actual kernel.
Old issue but Ii've been trying some proof of concepts on how this would work exactly. Using the docker sdk I was able to get papermill to proxy the commands to the docker container.. The main issue i ran into is this function https://github.com/nteract/papermill/blob/main/papermill/execute.py#L86 tries to process the notebooks locally before sending the papermill command to the docker container. Can't figure out to handle this cleanly right now I just have
https://github.com/AndersonReyes/papermill/commit/bf8d0366da255574f66a45a998c9b8c2515b51f8
Is this what you had in mind?
Only thing I can think off is moving all this logic https://github.com/nteract/papermill/blob/main/papermill/execute.py#L15
To the nbclient engine class so that each engine can handle the processing cli inputs but that's a lot of work which might not be worth the trouble
Also this could also very well be not needed anymore since it's easy to just create a docker file now a days with papermill installed and you just install papermill and execute the command see directly as entrypoint or cmd