BricksLLM
BricksLLM copied to clipboard
bricks-cloud
🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI...
Currently BricksLLM has a Datadog integration. We want to add OTEL integration that can provide compatibility with HyperDX.
Currently this API purely acts a proxy so anybody willing to integrate with different providers needs to also implement an SDK for each provider in their code (my use case)....
I have heard at least 3 users ask for it Issues: - Not all users can do a redeploy whenever there's a new model or price change - Some users...
We are developing some projects that occasionally trigger a 429 error due to exceeding our account’s usage limits, either because the applications make requests too quickly or because many users...
The call to `/api/providers/openai/v1/models` endpoint returns all models and does not respect the `allowed models` field specified when creating the provider settings. It would be nice to get only allowed...
- Uses OPENAI_API_URLS env var to supply map of openAI API URLs in format '=,=,...' - Allows BricksLLM to proxy both eu.api.openai.com and api.openai.com, e.g.: 'openai=https://api.openai.com,openai-eu=https://eu.api.openai.com' - When using the...
Currently, BricksLLM seems to have hardcoded the OpenAI base URL everywhere in the code as https://api.openai.com. But with OpenAI's Data Residency feature, projects in the Europe region need to use...
Currently the project doesn't offer any configuration for redis in-transit encryption. I believe that could be an easy win security wise as most production workloads would prefer to have that....
Is there a way to have a per minute rate limit and as well as a per day rate limit in a single API key ?
Metadata
Owner
Metadata
🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI...