gateway
gateway copied to clipboard
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
**Description:** Currently, we forward the anthropic `stop_reason`, which is not compatible with the openai `finish_reason`. This can cause warnings from some OpenAI sdk. The conversion function returns `stop` as a...
### What Would You Like to See with the Gateway? Conditional Check for Pre request validation ### Context for your Request _No response_ ### Your Twitter/LinkedIn _No response_
### What Would You Like to See with the Gateway? Locally through the REST mode, no need to configure config UI, how to configure through the head mode, give a...
### What Would You Like to See with the Gateway? Do I have to configure virtual key, fallback, and load balancing through the console? Can't you customize the code designation?...
**Title:** - Support [deepseek](https://www.deepseek.com/) provider
### What Happened? code ``` const { OpenAI } = require('openai'); const { PORTKEY_GATEWAY_URL, createHeaders } = require('portkey-ai'); const gateway = new OpenAI({ apiKey: process.env.ANTHROPIC_API_KEY, baseURL: PORTKEY_`GATEWAY_URL, defaultHeaders: createHeaders({ provider:...
**Title:** - Removed compression for node runtime since its buffering the response during streaming **Description:** - Removed compression middleware if runtime is node - Removed content-encoding header to disabled compression...