gateway
gateway copied to clipboard
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
https://docs.voyageai.com/reference/multimodal-embeddings-api https://docs.voyageai.com/reference/reranker-api
### What Would You Like to See with the Gateway? I'm really interested in having an API to sync my own templates with PortKey. I love the editor UI you've...
### What Happened? ## Issue Description The gateway fails to properly parse error messages when accessing Claude models on GCP Vertex AI via the streaming endpoint. The issue occurs when...
### What Would You Like to See with the Gateway? I'd like to import contents like `app`, `HooksManager` from this package (currently not possible), and integrate it with my sveltekit...
### What Would You Like to See with the Gateway? Plugin Name: Valid Numerical Range Plugin Description: Validates whether the generated number is in the acceptable range. Here is the...
### What Would You Like to See with the Gateway? Plugin Name: Medical Advice Detection Plugin Description: Detects Medical Advice in the generated response and flags a warning whenever the...
### What Would You Like to See with the Gateway? Plugin Name: NSFW Text check Plugin Description: Validates whether the given response has any NSFW words mentioned Here is the...
https://github.com/Portkey-AI/gateway/issues/1176 Testing: sample request body ```json { "model": "us.anthropic.claude-3-7-sonnet-20250219-v1:0", "anthropic_beta":"computer-use-2025-01-24", "max_tokens": 2000, "tools": [ { "type": "computer", "computer": { "name": "computer_20250124", "display_width_px": 1024, "display_height_px": 768, "display_number": 1 } } //...
### What Would You Like to See with the Gateway? ... ### Context for your Request _No response_ ### Your Twitter/LinkedIn _No response_
### What Would You Like to See with the Gateway? ... ### Context for your Request _No response_ ### Your Twitter/LinkedIn _No response_