Nathan Price
Nathan Price
Using that info I have a working middleware: ```python class CustomMiddleware(BaseHTTPMiddleware, PrometheusMiddleware): def __init__(self, app, *args, **kwargs): BaseHTTPMiddleware.__init__(self, app) PrometheusMiddleware.__init__(self, app, *args, **kwargs) async def dispatch(self, request: Request, call_next): method...
Any plans to support using body information in labels?
Any estimate on a timeline? Is this something I could help speed along with a PR? As best I can tell (though I am not very familiar with rust) the...
I took a stab in a PR. https://github.com/temporalio/sdk-python/pull/781 This was branched off of 1.10.0 tag because I was not able to get `uv build` to succeed on the main branch,...
Thinking about this more I am using a keda autoscaler on my backends.... Do I need to use AIbrix Auto scalers?
Also experiencing this when exploring upgrading my deployments base image from vllm-openai:v0.8.5 --> >= v0.9.XX Would prefer not not need to manually configure the LD_LIRBARY_PATH in my deployments though
I have been seeing similar errors in a deployment I have where datadog sidecars were enabled. Is this something we would need to patch into all our application workers ```...
Can you just use your base model to be model_1? Or are you needing to call model_0 still? Might be worth going through the matrix operations to determine if you...