factotum icon indicating copy to clipboard operation
factotum copied to clipboard

Add ability to limit step concurrency to prevent overloading limited systems

Open jbeemster opened this issue 3 years ago • 0 comments

When multiple steps in the DAG execute concurrently it can overload very limited dockerized solutions as it becomes difficult to predict how much compute will be needed at different stages of the execution.

By limiting concurrency this can be better controlled.

jbeemster avatar May 26 '21 19:05 jbeemster