Nitan Alexandru Marcel
Nitan Alexandru Marcel
> Yes, so you're only parsing 1 thing vs 1 for each API/model We'll have to wait for an answer from @trufae.
> Yes, so you're only parsing 1 thing vs 1 for each API/model Got the green. The other green not the high green
> > > Yes, so you're only parsing 1 thing vs 1 for each API/model > > > > > > Got the green. The other green not the high...
> > > Yes, so you're only parsing 1 thing vs 1 for each API/model > > > > > > Got the green. The other green not the high...
ah the version was too old, but still: ``` ModelResponse( │ id='chatcmpl-A730rEKe2r4dS5mn2BcCWYT9ILvQw', │ choices=[ │ │ StreamingChoices( │ │ │ finish_reason=None, │ │ │ index=0, │ │ │ delta=Delta( │...
I do parse the funtions myself now so maybe this is my issue
> I do parse the funtions myself now so maybe this is my issue Yep, I forgot how generators work 😅
> my comments on litellm: > > * it feels so comercial by checking the website > * im afraid of the amount of deps to make it too huge...
On the other side > It is commercial, I think they got some VC funding, although it's at least MIT licensed. It's not a crazy amount of deps, we'd want...
So, litellm or not, these can be done manually. + We can freely use parts of litellm in our code due to the dual license they use