If the canary is stuck in the promoting state, the service cannot be rolled back.

[cxftrue]

Describe the bug

If the canary is stuck in the promoting state, the service cannot be rolled back.

[ML-ZoneReaper]

Faced the same problem when the canary release had an error status. When I deleted it, the service selector and the number of replicas for the main application were not restored.

• Flagger version: 1.36.1
• Istio version: 1.17.8
• Kubernetes version: 1.19.10

Flagger logs:

{"level":"info","ts":"2024-03-27T13:33:52.345Z","caller":"controller/events.go:45","msg":"Rolling back web.frontend failed checks threshold reached 5","canary":"web.frontend"}
{"level":"info","ts":"2024-03-27T13:33:52.972Z","caller":"controller/events.go:45","msg":"Canary failed! Scaling down web.frontend","canary":"web.frontend"}
{"level":"info","ts":"2024-03-27T13:39:46.961Z","caller":"controller/controller.go:172","msg":"Deleting web.frontend from cache"}

[ML-ZoneReaper]

@stefanprodan do we need to provide more information in order to fix this issue?