skypilot icon indicating copy to clipboard operation
skypilot copied to clipboard

[Serve] `sky serve status` should show ready replicas at the top and ordered by the version

Open Michaelvll opened this issue 1 year ago • 1 comments

Currently the sky serve status show the replicas by the order of ID. However, the latest READY replicas should be more important and interesting to the user. Also, when the number of replicas increase, the current implementation hides the latest replicas, which is unexpected.

sky serve status
Services
NAME        VERSION  UPTIME      STATUS  REPLICAS  ENDPOINT            
code-llama  3        2h 15m 59s  READY   1/6       x.x.x.x:30002  

Service Replicas
SERVICE_NAME  ID  VERSION  IP             LAUNCHED    RESOURCES                    STATUS        REGION    
code-llama    1   1        -              -           -                            FAILED        -         
code-llama    2   1        x.x.x.x  2 hrs ago   1x Azure({'A100-80GB': 2}))  READY         eastus    
code-llama    3   1        -              -           -                            FAILED        -         
code-llama    4   1        -              -           -                            FAILED        -         
code-llama    5   1        -              -           -                            FAILED        -         
code-llama    6   1        -              -           -                            FAILED        -         
code-llama    7   1        -              1 min ago   1x Azure({'A100-80GB': 2}))  PROVISIONING  westus3   
code-llama    8   2       x.x.x.x  1 min ago   1x Azure({'A100-80GB': 2}))  STARTING      eastus    
code-llama    9   2        -              5 mins ago  1x Azure({'A100-80GB': 2}))  PROVISIONING  eastus    
code-llama    10  3        -              2 mins ago  1x GCP({'L4': 8}))           PROVISIONING  us-east4  
... (use --all to show all replicas)

Several things we should do:

  1. Make sure the later versions show at the top
  2. Have the ready replicas shown first

Michaelvll avatar Jan 30 '24 23:01 Michaelvll

cc'ing @cblmemo

Michaelvll avatar Jan 30 '24 23:01 Michaelvll