mysticeti icon indicating copy to clipboard operation
mysticeti copied to clipboard

[orchestrator] [Future request] Parallel EC2 requests

Open andll opened this issue 1 year ago • 2 comments

We seem to issue requests to AWS sequentially, and it actually takes a bit of time even on 10 node cluster, probably going to be unusable on 100 nodes. We should try instead to parallelize things as much as possible, e.g. every time we have some kind of array of instances we should issue AWS requests to those instances in parallel

andll avatar Jul 11 '23 22:07 andll