gateway

gateway copied to clipboard

### What Happened? The implementation is inconsistent and does not support sending HTTP urls and doesn't work for files other than images ### What Should Have Happened? _No response_ ###...

narengogi

[Feature] Create tokenizer for applying chat template for mistral, llama etc

2

### What Would You Like to See with the Gateway? Open source models like Llama and mistral expect instruction and completion inputs in a chat template format for optimal text...

narengogi

**Description:** - Added support for Stable diffusion v2Beta route with support for 3 text-to-image models. Core, Ultra and 3Large - Same support in Bedrock also - Added a new parameter...

narengogi

[Feature] Lowercase Check Plugin

2

### What Would You Like to See with the Gateway? Plugin Name: Lowercase Plugin Plugin Description: Passes when the text is entirely in lowercase. Here is the [Contributing Guide for...

siddharthsambharia-portkey

[Feature] Valid SQL PLugin

5

### What Would You Like to See with the Gateway? Plugin Name: Valid SQL Plugin Description: Validates whether the given SQL code is syntactically correct Here is the [Contributing Guide...

siddharthsambharia-portkey

How to integrate locally deployed models, such as the Qwen model deployed with vLLM, with an AI gateway?

8

### What Happened? I would like to use AI Gateway to manage a series of locally deployed models, but I'm not sure how to proceed. ### What Should Have Happened?...

wgimperial

### What Would You Like to See with the Gateway? Support SD3, SD Core, SD Ultra models in stability and bedrock providers ### Context for your Request _No response_ ###...

narengogi

perf: support type suggestions for hono context object

1

**Title:** Adds typescript support for `context` object which we use at multiple places `c.get` and `c.set` functions.

b4s36t4

feat: azure entra id integration

3

**Title:** - Integrate Azure Entra ID with Azure Inference and Azure OpenAI for Authentication **Description:** (optional) - Integrated Azure Entra ID for secure authentication across Azure services - Configured Azure...

sk-portkey

### What Would You Like to See with the Gateway? To Simplify resource management ### Context for your Request Simplify resource management ### Your Twitter/LinkedIn _No response_

sk-portkey