aibrix
aibrix copied to clipboard
Support debug port in gateway plugin
🚀 Feature Description and Motivation
service discovery is commonly misconfigured by users. However, we do not have every straightforward ways to help user diagnose the problem.
The most easiest way I can come up with is to provide a debug interface and expose the endpoint information. for deployment, model to pod list mapping is good. lora is same. for StormService, we need to list the roles
Use Case
gateway plugin
Proposed Solution
No response