dstack
dstack copied to clipboard
[Feature]: Process jobs in parallel
Problem
Running a service with multiple replicas starts them sequentially, not parallel. This limitation has no benefits
Solution
Process all available jobs in parallel, similar to process_runs
Benefit
Faster replica provisioning and better scalability in terms of parallel runs
Alternatives
Decrease the process_submitted_jobs
delay drastically
Would you like to help contributing this feature?
Yes
This issue is stale because it has been open for 30 days with no activity.
This issue was closed because it has been inactive for 14 days since being marked as stale.