elvers icon indicating copy to clipboard operation
elvers copied to clipboard

support the execution of a bunch of notebooks upon completion

Open ctb opened this issue 6 years ago • 2 comments

it would be great to have both standard and customized execution of notebooks after a run!

not sure how to make 'em conditional on the workflow run, but that can be a detail we figure out later.

I think Jupyter Notebooks and RMarkdown notebooks would be the primary things to support here. Would need to parameterize the notebooks e.g. via papermill.

ctb avatar Jan 26 '19 18:01 ctb

would also be nice to develop some notebooks to summarize and/or compare two or more runs. think a la mmetsp gigascience paper

ctb avatar Jan 26 '19 18:01 ctb

brainstorming a bit more --

  • provide default summary notebooks that get executed at the end of each step
  • have goal be HTML output
  • link those into a master 'run list of notebooks' in the top level directory, or something
  • also supply meta notebooks that take in a bunch of runs & maybe associated config files => do summarization/comparison

I'll be developing some of these for my GGG 201(b) course this term, so we'll see how that goes!

ctb avatar Jan 26 '19 18:01 ctb