gateway
gateway copied to clipboard
Portkey-AI
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
https://ai.google.dev/gemini-api/docs/function-calling
**Title: Allow to call a callback on streaming responses** **Description:** (optional) This PR allows to call a user-defined function (null-safe) with the stream content (list of chunks) **Motivation:** (optional) The...
### What Would You Like to See with the Gateway? ### Context for your Request _No response_ ### Your Twitter/LinkedIn _No response_
### What Happened? I've just learned that Cohere deprecated their `generate` endpoint and that my fine-tune model is not working with Portkey. Ref: https://docs.cohere.com/reference/chat How should we go about this?...
### What Would You Like to See with the Gateway? It would be great to be able to use things like Llama3 models hosted in Azure Machine Learning via Online...
https://discord.com/channels/1143393887742861333/1144615709360521352/1210307246068732005
Metadata
Owner
Metadata
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.