gateway

gateway copied to clipboard

Portkey for Self Hosted LLMs in a VM?

1

### What Happened? Is Portkey compatible with a self hosted LLM running on a VM. I can't use Mistral API from Mistral Cloud or anywhere else? ### What Should Have...

AIAnytime

https://dev.hume.ai/reference/empathic-voice-interface-evi/prompts/get-return-prompts-for-user

vrushankportkey

### What Would You Like to See with the Gateway? Support of Local model, we should be able to use our local models by just passing the baseUrl in the...

khursheed33

Request to stream a chat completion results in buffered response instead of stream

1

### What Happened? I tried running the gateway locally using `npx @portkey-ai/gateway`, `node run dev:node` and `node build/start-server.js` (Node 18). I noticed that even though I was specifying the "stream"...

au-re

### What Would You Like to See with the Gateway? Please build the PortKey extension for the [kernel-memory](https://github.com/microsoft/kernel-memory) ### Context for your Request It will be great for the C#...

ranjancse26

### What Would You Like to See with the Gateway? Please build the PortKey extension for the [semantic-kernel](https://github.com/microsoft/semantic-kernel) ### Context for your Request It will be great for the C#...

ranjancse26

### What Would You Like to See with the Gateway? It would be great if you could add function calling support in the OpenAI client for one or both of...

AWKohler

[Provider] Huggingface Text Embeddings Inference

2

https://github.com/huggingface/text-embeddings-inference

vrushankportkey

[Feature] API version should be dynamic ?

3

### What Would You Like to See with the Gateway? As a user, the AI model API version should have dynamic parameters like a model.  Currently, https://github.com/Portkey-AI/gateway/blob/27a6ebbc9ddd972ef1a716176fc17d0b2671c366/src/providers/google/api.ts#L4 is hardcoded. Due...

AvinashDalvi89

https://www.voyageai.com/

vrushankportkey