EdgeChains icon indicating copy to clipboard operation
EdgeChains copied to clipboard

Convert the endpoints to a smart router like litellm does in python #286

Open PIYUSH-MISHRA-00 opened this issue 11 months ago • 4 comments

/claim #286 The Router class has been successfully implemented with all required features:

Load balancing between OpenAI, Google PaLM, and Cohere endpoints Streaming capability for real-time responses Token usage tracking and rate limiting Logging integration with Sentry and PostHog Configuration through Jsonnet files The code is properly typed and follows TypeScript best practices. The PostHog integration has been fixed to use the correct Node.js client API.

PIYUSH-MISHRA-00 avatar Jan 03 '25 04:01 PIYUSH-MISHRA-00

CLA Assistant Lite bot: Thank you for your submission, we really appreciate it. Before we can accept your contribution, we ask that you sign the Arakoo Contributor License Agreement. You can sign the CLA by adding a new comment to this pull request and pasting exactly the following text.


I have read the Arakoo CLA Document and I hereby sign the CLA


You can retrigger this bot by commenting recheck in this Pull Request

github-actions[bot] avatar Jan 03 '25 04:01 github-actions[bot]

hi @PIYUSH-MISHRA-00 I saw your commit just now. This was a very old bounty fyi. But I saw ur commit and can talk to our grant committee.

Can u please join our discord and message me please

sandys avatar Jan 05 '25 07:01 sandys

@PIYUSH-MISHRA-00 pinging again

sandys avatar Jan 08 '25 11:01 sandys

I have send you the friend request and message as well on Discord. Please check @sandys

PIYUSH-MISHRA-00 avatar Jan 08 '25 15:01 PIYUSH-MISHRA-00