Limit number of parrallel jobs per node/worker

[deforation]

In Short It would be useful to have a parameter on the node specifying how many jobs it can process at the same time.

Situation The point is, we have about 80 nodes and scheduled it in such a way, that at a time (with a shift of about 15 seconds between the job executions), at maximum 45 jobs are running.

Issue Despite having a vatly lower number of jobs with a big delay between them, dkron quite often sends the job to the same node/worker. As a result, they take much longer to finish because they are really I/O intensive.

Additional Information All the nodes have a tag "type=gen" And the jobs are executed on the tag "type":"gen:1"

[LevonW-IIS]

This would be incredibly useful. Without this feature, will likely have to move to using a different task scheduler.

[vcastellm]

Hi @LevonW-IIS, this feature is in the roadmap and some work started, but I wasn't sure if there would be enough demand for it, as of now you are the first or second one requesting it.

Out of curiosity, do you know any other task scheduler that implements any form of solution for this?