gateway

gateway copied to clipboard

[Feature] Function / Tool Calling for Mistral

1

### What Would You Like to See with the Gateway? Currently it seems like the mistral provider does not support tool calling. It's available now though https://docs.mistral.ai/capabilities/function_calling/ and should probably...

flipace

Anthropic chat completion missing `assistant` role

1

### What Happened? When using anthropic with langchain, langchain won't be able to parse out tool calls since it depends on the role of the response delta to determine whether...

flipace

400 anthropic error: messages.2: the following `tool_use` ids were not found in `tool_result` blocks

11

### What Happened? I tried invoking multiple tools and it broke using Anthropic. ### What Should Have Happened? It should work with multiple tool invocation. ### Relevant Code Snippet ```js...

lucgagan

[Feature] AWS AssumeRoleWithWebIdentity Support for Bedrock

4

### What Would You Like to See with the Gateway? The Portkey AI Gateway should allow users to set the `AWS_WEB_IDENTITY_TOKEN_FILE` and `AWS_ROLE_ARN` environment variables, which can then be used...

cohen-raphael

[Feature] remove temperature param in case of reasoning models like o1 and o3

2

### What Would You Like to See with the Gateway? Some libraries like Vercel AI send a default `temperature: 0` value, that breaks the calls to reasoning models of OpenAI,...

carlosveloso

improvement: handle azure workload identity authentication

4

**Title:** - Handle azure workload identity authentication **Description:** (optional) So far the Azure OpenAI integration was handling authentication using Client ID / Client Secret and Managed identity using the IMDS...

abestel

https://github.com/Portkey-AI/gateway/blob/a5ebc6aa57dea40f37339f7b0310fa91a18f41ff/src/public/index.html#L1581C7-L1581C49

universeroc

### What Would You Like to See with the Gateway? Some of the providers like bedrock do not return the model in the response json when invoking endpoints like completions...

narengogi

### What Would You Like to See with the Gateway? Anthropic has started accepting public image urls now, previously only base64 encoded images were supported.  ### Context for your...

narengogi

Portkey integration llama-index

1

Question I am running into the following error when I am trying to integrate Portkey: `PydanticUserError: "Portkey" is not fully defined; you should define "Modes", then call Portkey.model_rebuild().` My import...

infestissumam00