api-manager
api-manager copied to clipboard
[Intra Vendor Model Routing][Publisher Portal] Model Failover and Model Round Robin AI Policies Can Be Attached to the Same API
Description
Users are able to attach both Model Failover and Model Round Robin AI policies to the same API, which is a prohibited action.
Expected Behaviour
- Users should be allowed to select only one AI policy between failover(failover) and round robin (model round robin, weighted round robin) policies.
Actual Behaviour
- Users can attach both failover and round robin policies to same API.
Steps to Reproduce
- Click Create AI/LLM API, fill in the required fields, and click Create.
- Navigate to API Configuration->Policies
- Drag and drop both Model Failover and Model Round Robin/Model Weighted Round Robin policies in to the Request Flow.
Version
4.5.0-beta
Environment Details (with versions)
No response