gateway icon indicating copy to clipboard operation
gateway copied to clipboard

Published 20 hours ago • verified publisher icon Portkey-AI

[Provider] Add Deepinfra

Open vrushankportkey opened this issue 1 year ago • 8 comments

Docs: https://deepinfra.com/docs

vrushankportkey avatar Jan 09 '24 04:01 vrushankportkey

Hello, if this is available can I take a look at this? its something new for me but want to give it a try :).

Suraj-Bhandarkar-S avatar Jan 11 '24 14:01 Suraj-Bhandarkar-S

Hi @Suraj-Bhandarkar-S yes, this is an open issue that you can work on. Thank you so much for contributing to the project!

vrushankportkey avatar Jan 11 '24 15:01 vrushankportkey

@vrushankportkey @Suraj-Bhandarkar-S mind if I give it a try as well?

vidurkhanal avatar Jan 11 '24 17:01 vidurkhanal

Please feel free to collaborate/contribute. I think as the project grows, the best practices on this should emerge. I'd suggest to use this thread to collaborate.

vrushankportkey avatar Jan 11 '24 18:01 vrushankportkey

@vidurkhanal Thank you :) I have started to work, will try if any thing will post in the thread. Thanks again

Suraj-Bhandarkar-S avatar Jan 12 '24 07:01 Suraj-Bhandarkar-S

Hey folks. Just checking up on this. Please let me know if there are any blockers that you are facing.

VisargD avatar Jan 16 '24 10:01 VisargD

Hey @VisargD, as of today the only service offered by deepinfra is inference (emitting a models output as it is). The confusion is which action would it fall under. Would it be chat or embed!?

vidurkhanal avatar Jan 16 '24 14:01 vidurkhanal

Deepinfra has an OpenAI compatible API: https://deepinfra.com/docs/advanced/openai_api

You can simply map this API with /chat/completions route of gateway

VisargD avatar Jan 16 '24 19:01 VisargD