factotum icon indicating copy to clipboard operation
factotum copied to clipboard

A system to programmatically run data pipelines

Results 48 factotum issues
Sort by recently updated
recently updated
newest added

![factotum_tree_inefficient](https://cloud.githubusercontent.com/assets/5323141/13961259/bd5af56c-f053-11e5-98f5-68fb4ac829b0.png) The above image on the right displays how factotum executes steps, the numbers and colours indicate what is run with what. In this case the total run-time can be...

This is split off from #25 as it requires a bit of investigation and isn't critical

Need to come up with a JSON Schema for this

scheduler-audit

Use Vault as the back-end?

authentication

Taking a look at #2 each step seems to be a shell execution. Taking a look at airflow one of the nice things they have is the ability to execute...

So as soon as one run of the job has finished, start the next one. Need to figure out what should happen on a failure - keep looping or die?

scheduler