gateway
gateway copied to clipboard
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
### What Would You Like to See with the Gateway? openai has added new routes: listChatCompletions getChatCompletion getChatCompletionMessages updateChatCompletion (for updating metadata) deleteChatCompletion refer: https://platform.openai.com/docs/api-reference/chat ### Context for your Request...
### What Would You Like to See with the Gateway? Anthropic supports citing text and pdfs now: https://docs.anthropic.com/en/docs/build-with-claude/citations 2 problems with openAI compatibility are: 1. openai does not support sending...
### What Would You Like to See with the Gateway? AI Gateway already has an extremely performant architecture (100k rpm on 2 vCPUs). We want to continue to invest in...
### What Would You Like to See with the Gateway? With Portkey, enterprises are able to collect extremely valuable production data flowing through our AI gateway. We are building features...
### What Would You Like to See with the Gateway? We're seeing extremely positive RoIs from engineering teams building AI Agents at enterprises. We are doubling down on observability, instruction...
### What Would You Like to See with the Gateway? more details here - https://portkey.ai/mcp ### Context for your Request _No response_ ### Your Twitter/LinkedIn _No response_
### What Would You Like to See with the Gateway? The current ai21 integration only supports the regular chat completions transformation, streaming transformation is not supported docs: https://docs.ai21.com/reference/jamba-15-api-ref ### Context...
### What Would You Like to See with the Gateway? some mistral models are supported in vertex openai compliant endpoint, whereas some of them like mistral-large need the request body...
### What Would You Like to See with the Gateway? the older jurrassic and jamba instruct models have been deprecated and the api signature has also changed https://docs.ai21.com/reference ### Context...
**Documentation : Update installation-deployments.md** Added steps of deployment for - Vercel - Fastly - AWS Lambda - Lambda@edge - Supabase Functions **Motivation:** - Enhances ease for users (devs).