gateway

gateway copied to clipboard

### What Would You Like to See with the Gateway? anthropic specific tools are already supported for anthropic and vertex as they use the same transforms, this is a ticket...

narengogi

chore: batch & fine-tune improvements

8

## Description * Fine-tune support for vertex * Batch embedding support for vertex * preserve custom_id for the vertex batch output. * streamlined responses for vertex with OAI. ## Motivation...

b4s36t4

Integration: Bytez Chat Model Provider

5

## Description Hi all! :wave: We're Bytez, the largest model provider on the internet! We may also be one of the cheapest if not the cheapest. We'd love to integrate...

inf3rnus

integrated CrofAI (in theory)

11

## Description Should add CrofAI as a provider in portkey gateway ## Motivation Is the cheapest inference provider for almost every large LLM ## Type of Change - [ ]...

scuzzles

Feature: Beta support for /v1/messages route

4

TO-DO: - [ ] model specific additional fields TO-DO (subsequent versions): - [ ] support stream concatenation for caching - [ ] fix types for bedrock Testing Done: - [...

narengogi

Remove redundant apk update calls in Dockerfile

7

## Description Remove redundant `apk update` calls in Dockerfile. The `apk upgrade` commands already utilize the `--no-cache` option, making the separate update step superfluous and ensuring the latest packages are...

PeterDaveHello

"Illegal invocation" error with Portkey SDK in Cloudflare Worker

5

### What Happened? **Bug Description:** When using the `portkey-ai` SDK within a Cloudflare Worker, calls to `portkey.chat.completions.create()` result in a runtime error: `{"error":"Server error","detail":"Illegal invocation: function called with incorrect \`this\`...

x-creates

feat: multimodal embeddings for bedrock titan and cohere

1

This PR adds support for multimodal embeddings in compliance with the portkey signature: example requests: 1. Titan text embedding: ```sh curl --location 'http://localhost:8787/v1/embeddings' \ --header 'x-portkey-provider: bedrock' \ --header 'Content-Type:...

narengogi

### What Would You Like to See with the Gateway? ... ### Context for your Request _No response_ ### Your Twitter/LinkedIn _No response_

vrushankportkey

### What Would You Like to See with the Gateway? ... ### Context for your Request _No response_ ### Your Twitter/LinkedIn _No response_

vrushankportkey