Igor Drobiazko

Provide a way to configure secrets to download private Docker images

6

This is not critical yet as we can work with open Docker images in the beginning but this becomes critical for private components

[Feature]: Expose original HTTP headers returned by the LLM APIs

11

### The Feature The LLM APIs send multiple headers in their response that are utilized in our system for analysis. When switching to the LiteLLM Proxy Server, these headers are...

Expose rate limits in headers to all endpoints of AzureOpenAI API

3

At the moment the only way to handle [TPM and RPM rate limits](https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/quota?tabs=rest#understanding-rate-limits) is to receive a HTTP 429 error response and wait until the limit is reset. A better...

API for destroying JVM

14

Is there any way to invoke [this deconstructor](https://github.com/joeferner/node-java/blob/master/src/java.cpp#L88-L90) from Node code? We'd like to have an API for destroying the JVM.