[Feature]: In-place update for service properties that do not require redeployment

[jvstme]

Problem

These service configuration properties only affect how the proxy handles requests to the service:

• port
• model
• https
• auth
• rate_limits

Although these properties do not affect the running replicas, changing them currently requires redeploying all replicas.

Solution

Support in-place update without replica redeployment for these properties.

Workaround

Implementation note

Will require changing the gateway registry API to allow existing services to be updated. Currently, the registry API only allows to create a new service or delete an old one.

Would you like to help us implement this feature by sending a PR?

Yes