aibrix icon indicating copy to clipboard operation
aibrix copied to clipboard

Support debug port in gateway plugin

Open Jeffwan opened this issue 2 months ago • 0 comments

🚀 Feature Description and Motivation

service discovery is commonly misconfigured by users. However, we do not have every straightforward ways to help user diagnose the problem.

The most easiest way I can come up with is to provide a debug interface and expose the endpoint information. for deployment, model to pod list mapping is good. lora is same. for StormService, we need to list the roles

Use Case

gateway plugin

Proposed Solution

No response

Jeffwan avatar Oct 20 '25 05:10 Jeffwan