add support for bedrock, togetherai, huggingface tgi, replicate, ai21, cohere, ai21

[krrishdholakia]

trafficstars

Hi @Mearman @Ying1123,

Noticed you're calling the openai chat completions endpoint. I'm working on litellm (simple library to standardize LLM API Calls - https://github.com/BerriAI/litellm) and wanted to see how i could be helpful.

My PR adds support for new LLM providers (bedrock, togetherai, huggingface tgi, replicate, ai21, cohere, ai21 etc.) by replacing openai's ChatCompletion with litellm.completion.

Curious if you find this useful?

Happy to add additional tests/documentation if the initial PR looks good.