gateway

gateway copied to clipboard

feat: add tls options support

7

## Description Add tls options support. Supporting custom Certificate Authority + Ignore certificate issues. Options can be send via x-portkey-tls-options header which is parsed later on and used for custom...

arturfromtabnine

### What Happened? When making a request to self-hosted model `deepseek-r1-distill-qwen-32b` to `/v1/chat/completions`, model thinking is incorrect formatted or provided. curl: ```curl curl --request POST \ --url http://localhost:8787/v1/chat/completions \ --header...

MateuszKepczynski

I have setup the gateway locally. And I have a mock server which has exposed an OpenAI compatible` /chat/completions` endpoint. I am unable to create the config using config_resp =...

AbhishekBose

Support MCP Agents on the Gateway

2

Support MCP tool calls on Portkey. Portkey will be able to support mcp subagents directly on the gateway.

roh26it

Feat/prompt guardrail

1

## Description Enhanced the Portkey prompt plugin with comprehensive type definitions for expected results and implemented a robust verdict checking system. Currently support boolean prompts only with support for choices,...

roh26it

### What Would You Like to See with the Gateway? Currenty, gemini chat complete tool calling only supports google_search, but recently google added url context tool, But there is only...

marsimon

Vendoring OpenAI SDK causing bugs

2

### What Happened? Working in https://github.com/mozilla-ai/any-llm , after adding portkey_ai python package, I started seeing these strange error messages in tests that should have been unrelated; FAILED tests/integration/test_response_format.py::test_response_format[openai] - AttributeError:...

njbrake

improvement: updated ai21 integration

2

## Description Updated Chat Completions API endpoint, and also modified API configs and response interface ## Motivation This updates the existing outdated ai21 integration and fixes #1215 ## Type of...

Utkarsh-0304

Can NOT connect to Qdrant through Portkey integration

1

### What Happened? **Issue Description** I cannot connect to Qdrant through Portkey integration. **Steps to Reproduce** 1. Create an integration to Qdrant in Portkey, given the `New Base URL`, `Authorization`...

seanzhow7586

[Feature] Better logging

1

### What Would You Like to See with the Gateway? Logging is broken in the console right now, if you use streams, the logs break. Additionally, there should be a...

jczstudios