gateway

gateway copied to clipboard

## Description This PR adds a fix for bedrock messagesUtils where we did not handle empty tool calls before. ## Motivation This was needed to fix claude code failing calls...

siddharthsambharia-portkey

feat: add thinking parameter to OllamaChatCompleteConfig

1

## Description This PR adds thinking parameter support for Ollama provider ## Motivation -- ## Type of Change - [ ] Bug fix (non-breaking change which fixes an issue) -...

siddharthsambharia-portkey

simplify openai base transform for chat complete

2

noticed that the openai chat complete base transforms are missing a few parameters like `top_logprobs` and `parallel_tool_calls` I've used the openai caht complete transformation config and I've added a line...

narengogi

### What Happened? User report verbatim > Hi Portkey team, I've just noticed that the top_logprobs don't seem to be available when I'm calling a finetuned version of gemini. They...

narengogi

siddharthsambharia-portkey

Sample Strategy

2

## Description New Gateway strategy: Sample Quick info: The sample strategy fans out a single gateway request to multiple targets in parallel and returns the first-success response. It’s useful for...

vrushankportkey

[Feature] TextCompletion for Cerebras Provider

1

### What Would You Like to See with the Gateway? This time I checked that Cerebras does still support text completion endpoints. https://inference-docs.cerebras.ai/api-reference/completions Any plans to support it? Thanks! ###...

ianbbqzy

feat: cleanup plugin & support different auth modes for plugin based …

7

…on runtime ## Description ## Motivation ## Type of Change - [ ] Bug fix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds...

b4s36t4

improved cache handling

3

improved cache handling with methods to use the default cache in different environments (node, workerd) please merge this after APM changes https://github.com/Portkey-AI/gateway/pull/1394 (this branch has changes from that branch merged)

narengogi

Tool injector guardrail

1

## Description ## Motivation ## Type of Change - [ ] Bug fix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) -...

vrushankportkey