EdgeChains
EdgeChains copied to clipboard
Convert the endpoints to a smart router like litellm does in python #286
/claim #286 The Router class has been successfully implemented with all required features:
Load balancing between OpenAI, Google PaLM, and Cohere endpoints Streaming capability for real-time responses Token usage tracking and rate limiting Logging integration with Sentry and PostHog Configuration through Jsonnet files The code is properly typed and follows TypeScript best practices. The PostHog integration has been fixed to use the correct Node.js client API.
CLA Assistant Lite bot: Thank you for your submission, we really appreciate it. Before we can accept your contribution, we ask that you sign the Arakoo Contributor License Agreement. You can sign the CLA by adding a new comment to this pull request and pasting exactly the following text.
I have read the Arakoo CLA Document and I hereby sign the CLA
You can retrigger this bot by commenting recheck in this Pull Request
hi @PIYUSH-MISHRA-00 I saw your commit just now. This was a very old bounty fyi. But I saw ur commit and can talk to our grant committee.
Can u please join our discord and message me please
@PIYUSH-MISHRA-00 pinging again
I have send you the friend request and message as well on Discord. Please check @sandys