gateway
gateway copied to clipboard
[deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications
- Add **ChatCompletions** and **StreamChatCompletions** API support for Perplexity
- Add **ChatCompletions** and **StreamChatCompletions** API support for Replicate
- Add **ChatCompletions** and **StreamChatCompletions** API support for Perplexity
- Add **ChatCompletions** and **StreamChatCompletions** API support for lepton
- Add **ChatCompletions** and **StreamChatCompletions** API support for Anthropic
- Add **ChatCompletions** and **StreamChatCompletions** API support for Azure OpenAI
- Add **ChatCompletions** and **StreamChatCompletions** API support for Bedrock
- Add **ChatCompletions** and **StreamChatCompletions** support for Fireworks.ai
# Description This pull request introduces a new feature that allows for fine-tuning of transformer models from HuggingFace within our LLM (Large Language Models) gateway. It includes backend implementations for...
# Description This pull request introduces significant enhancements to the gateway's load balancing capabilities, focusing on ensuring that operations are only directed towards healthy providers. By integrating health checks across...