dstack icon indicating copy to clipboard operation
dstack copied to clipboard

[Feature]: Process jobs in parallel

Open Egor-S opened this issue 3 months ago • 1 comments

Problem

Running a service with multiple replicas starts them sequentially, not parallel. This limitation has no benefits

Solution

Process all available jobs in parallel, similar to process_runs

Benefit

Faster replica provisioning and better scalability in terms of parallel runs

Alternatives

Decrease the process_submitted_jobs delay drastically

Would you like to help contributing this feature?

Yes

Egor-S avatar Mar 08 '24 15:03 Egor-S

This issue is stale because it has been open for 30 days with no activity.

peterschmidt85 avatar Apr 08 '24 01:04 peterschmidt85

This issue was closed because it has been inactive for 14 days since being marked as stale.

peterschmidt85 avatar Apr 22 '24 01:04 peterschmidt85