gateway

gateway copied to clipboard

  **Title:** Add request, response log for the Portkey PII plugin to the main request trace ### 🔄 What Changed - Added new interfaces for structured logging...

roh26it

AWS Bedrock Validation Exception Not Handled.

8

### What Happened? When uploading an image through Portkey, the outgoing request to Bedrock API returned a 200 with a "application/vnd.amazon.eventstream". However, the stream's sole message was `exception{"message":"The model returned...

jczstudios

  ## Author Description **Title:** This fixes an issue where some unhandled errors thrown by `tryPost` cause big issues. Due to some loose typing, it was possible...

jpulec

[Feature] Access AWS Bedrock through a gateway.

1

### What Would You Like to See with the Gateway? How can we invoke Secrets Manager to access Bedrock using Gateway, and how can we poll for access-key-id and secret-access-key?...

wyn20140226

[Provider] Add support for Lepton AI

7

### What Would You Like to See with the Gateway? https://www.lepton.ai/docs ### Context for your Request _No response_ ### Your Twitter/LinkedIn _No response_

ashirwad19

Bedrock Claude 3.7/3.5v2 Prompt caching support

1

### What Would You Like to See with the Gateway? Prompt caching is now generally available for 3.7 sonnet, and in preview mode for 3.5v2 https://docs.aws.amazon.com/bedrock/latest/userguide/prompt-caching.html ### Context for your...

kevo1ution

Unhandled Promise Rejections

2

### What Happened? Seeing some `unhandledPromiseRejection`s get thrown out the top, in what appears to be cases where portkey isn't fully consuming the response. It appears to be similar to...

jpulec

[Feature] Migrate Cohere Chat Completions to v2

1

### What Would You Like to See with the Gateway? I think v1 has been deprecated, the integration might be broken checkout these docs for reference: https://docs.cohere.com/reference/chat ### Context for...

narengogi

[Feature] Allow to proxy requests via HTTP proxy

5

### What Would You Like to See with the Gateway? I would like to be able to pass through a proxy URL via headers, e.g. `x-portkey-http-proxy: http://my-proxy` so that I...

lilouartz

[Feature] Vertex Context caching

3

### What Would You Like to See with the Gateway? Add support for Vertex Context caching ### Context for your Request https://cloud.google.com/vertex-ai/generative-ai/docs/context-cache/context-cache-overview ### Your Twitter/LinkedIn _No response_

sk-portkey