gateway
gateway copied to clipboard
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
Could you please make sure to publish the Open API Specification for the Portkey Restful API? It's really important for everyone to understand, so they spend a minimal time in...
Here's the thought based on the extensive experience in the field of building the workflow based LLM apps using the various open source libraries or frameworks; among them, [Lastmile Aiconfig](https://github.com/lastmile-ai/aiconfig)...
Some comments: > I’d like to deploy the gateway but to make sure only my users will be able to use it; and I’d like to keep an option to...
**Title:** - Replace hono deprecated method and variables with latest supported ones **Description:** (optional) - Replace c.runtime with getRuntimeKey() function - Replace c.req.headers with c.req.raw.headers **Motivation:** (optional) - To stay...
In the next majore release (v4) of [hono.dev](https://hono.dev/), they will remove a few properties and methods. This repo uses couple of them. Here is the list of deprecated hono properties...
> Note: This could also be considered a "Plugin" depending upon which capabilities the gateway can support Docs: https://docs.multion.ai/
**Title:** docs with Chinese **Description:** (optional) - add README.cn.md - add CONTRIBUTING.cn.md - add CODE_OF_CONDUCT.cn.md - change CODE_OF_CONDUCT.md - A directly spliced hyperlink was used because it was not expected...
Hi I'm having an issue running the gateway locally. Here is my code. I get the error "TypeError: Completions.create() got an unexpected keyword argument 'headers'". Can you please help? from...
**Title:** - Brief Description of Changes **Description:** (optional) - Detailed change 1 - Detailed change 2 **Motivation:** (optional) - Why this change is necessary or beneficial **Related Issues:** (optional) -...