skypilot icon indicating copy to clipboard operation
skypilot copied to clipboard

Can Sky prioritize regions with quota available?

Open infwinston opened this issue 2 years ago • 2 comments

Kevin's question: I asked for V100 but Sky kept spending minutes on regions that I don't have quota. Is there any way to specify regions for Sky to prioritize? (my translation: sky launch is too slow)

infwinston avatar Mar 30 '22 00:03 infwinston

Two possible solutions:

  1. Sky looks up quotas for each cloud and prioritize those regions/clouds with available quota.
  2. Sky lets users to specify desirable regions.

For 1) I survey a couple commands that can be useful for Sky to query quotas.

> gcloud alpha services quota list --service=compute.googleapis.com --consumer=projects/intercloud-320520 --format json
 
{
  "defaultLimit": "8",
  "dimensions": {
    "region": "us-west1"
  },
  "effectiveLimit": "8"
}

> aws service-quotas list-service-quotas --service-code ec2 --region us-east-1 --query "Quotas[*].{ServiceName:ServiceName,QuotaName:QuotaName,QuotaCode:QuotaCode,Value:Value}" --output json

{
    "ServiceName": "Amazon Elastic Compute Cloud (Amazon EC2)",
    "QuotaName": "Running On-Demand P instances",
    "QuotaCode": "L-417A185B",
    "Value": 128.0
},

> az vm list-usage --location "East US" -o table

Standard NCSv3 Family vCPUs               0               192
Standard NDSv2 Family vCPUs               0               40

each command takes 3~6s. seems reasonable.

infwinston avatar Mar 30 '22 01:03 infwinston

This may also be helpful: https://github.com/brennerm/aws-quota-checker

gmittal avatar Mar 30 '22 07:03 gmittal