law icon indicating copy to clipboard operation
law copied to clipboard

Write docs

Open riga opened this issue 8 years ago • 2 comments

Write doc strings and the structure for the doc pages.

Pages

  • [ ] Tasks
  • [ ] Targets
  • [ ] Workflows
  • [ ] Sandboxing
  • [ ] Configuration
  • [ ] Commandline Interface

API

  • [x] cli
  • [x] job
    • [x] base
    • [x] dashboard
  • [ ] sandbox
    • [ ] base
    • [ ] bash
    • [ ] docker
    • [ ] singularity
  • [ ] target
    • [ ] base
    • [ ] file
    • [ ] local
    • [ ] remote
    • [ ] collection
    • [ ] formatter
  • [ ] task
    • [ ] base
  • [x] workflow
    • [x] base
    • [x] local
    • [x] remote
  • [x] config
  • [x] decorator
  • [x] parameter
  • [x] logger
  • [x] parser
  • [x] patches
  • [x] util

Contrib

  • [ ] arc
  • [ ] cms
  • [ ] dropbox
  • [ ] git
  • [ ] glite
  • [ ] htcondor
  • [ ] keras
  • [ ] lsf
  • [ ] matplotlib
  • [ ] mercurial
  • [ ] numpy
  • [ ] root
  • [ ] tasks
  • [ ] tensorflow
  • [ ] wlcg

riga avatar Dec 04 '16 00:12 riga

Note: In the documentation of Workflows, the concept of a "proxy" task is never really explained. Why do we need a proxy task? I read this 10 times and I still don't fully understand how workflows and proxy tasks work, nor when they should be used.

choucavalier avatar Aug 25 '23 16:08 choucavalier

Workflow proxies are a way to tell luigi not to use the run(), output() and requires() methods defined in the task itself by the user when branch is -1. In this case, all calls are forwarded to the workflow proxy's methods, which can do something completely different, depending on their workflow type.

Local workflows would just run their branches, whereas remote workflows (slurm, htcondor, etc.) would wrap them into jobs and submit them.


Side note: I'm currently writing a paper on law, which is why I'm closing some loose ends these days. I will eventually also finish the docs and add actual tests.

riga avatar Aug 26 '23 10:08 riga