gateway icon indicating copy to clipboard operation
gateway copied to clipboard

[Provider] Add support for AI21 models

Open vrushankportkey opened this issue 2 years ago • 8 comments

Docs: https://docs.ai21.com/reference/j2-complete-api-ref

vrushankportkey avatar Sep 26 '23 12:09 vrushankportkey

Hi @vrushankportkey, can I please work on this issue if its available?

kritikash18 avatar Oct 01 '23 06:10 kritikash18

Thank you, @kritikash18 - assigned to you.

Cheers!

vrushankportkey avatar Oct 01 '23 17:10 vrushankportkey

@vrushankportkey just wanted to confirm if there is any baseline for the APIs that need to be supported since the API types for AI21 are different than regular chat, complete and embedding APIs as AI21 provides specific service APIs instead. APIs offered:

complete API datasets APIs (get/delete) custom model APIs (training/get/complete/epoch) tokenize API task-specific APIs - (paraphrase/grammatical error corrections/ summarize, ..etc)

do I need to support a fixed subset or all?

kritikash18 avatar Oct 03 '23 08:10 kritikash18

Hey. You can start with the complete API. Structure for adding a new provider can be seen under https://github.com/Portkey-AI/Rubeus/tree/main/src/providers. Please let me know if you have any doubts once you go through the code.

VisargD avatar Oct 04 '23 06:10 VisargD

Raised #21

kritikash18 avatar Oct 07 '23 04:10 kritikash18

Thanks @kritikash18 . Will take a look into this

VisargD avatar Oct 07 '23 09:10 VisargD

Thank you for raising the PR so quickly, @kritikash18 ⚡

Are you there on the Portkey discord?

vrushankportkey avatar Oct 09 '23 10:10 vrushankportkey

Hi, joined now...the username is bytecode_bc

kritikash18 avatar Oct 09 '23 10:10 kritikash18