gateway

gateway copied to clipboard

Dani

1

Eldano2

[Provider] Add Deepinfra

8

Docs: https://deepinfra.com/docs

vrushankportkey

User management support

6

Thanks for open-sourcing the LLM gateway. Curious to learn if you are going to add support for user management. E.g., feature where I can share API keys with specific users...

harshsinghal

Support OPEN AI spec across providers and models

3

Thank you for such an excellent library. I wanted to report some tests and discussions arising from https://discord.com/channels/1143393887742861333/1194248563199311942 The gateway currently does not support the latest format in the Open...

raulraja

https://github.com/Portkey-AI/gateway/pull/101

vrushankportkey

- https://github.com/Portkey-AI/gateway/blob/1ccb963e89664203afde7ce6e77f9a14b7f0736a/wrangler.toml#L2 - https://github.com/Portkey-AI/gateway/blob/1ccb963e89664203afde7ce6e77f9a14b7f0736a/src/handlers/proxyGetHandler.ts#L73 - https://github.com/Portkey-AI/gateway/blob/1ccb963e89664203afde7ce6e77f9a14b7f0736a/src/handlers/handlerUtils.ts#L246 - https://github.com/Portkey-AI/gateway/blob/1ccb963e89664203afde7ce6e77f9a14b7f0736a/src/handlers/proxyHandler.ts#L173

vrushankportkey

Based on their commits, the API is: https://route.withmartian.com/api/openai/v1 https://github.com/openai/openai-python/compare/main...withmartian:martian-python-v1:main

vrushankportkey

[Provider] Add Lemonfox

2

https://www.lemonfox.ai/

vrushankportkey

[Provider] Amazon Bedrock

7

vrushankportkey

[Provider] support for AI21 model

3

addresses #12

kritikash18