paper-qa icon indicating copy to clipboard operation
paper-qa copied to clipboard

adding support for claude, azure, cohere, replicate

Open krrishdholakia opened this issue 2 years ago • 1 comments

Hi @whitead

Noticed you're calling OpenAI w/ langchain. I'm working on litellm (simple library to standardize LLM API Calls - https://github.com/BerriAI/litellm) and was wondering if we could be helpful.

Added support for Claude, Cohere, Azure and Llama2 (via Replicate) by setting client in the langchain ChatOpenAI class. The code is pretty similar to the OpenAI class - as litellm follows the same pattern as the openai-python sdk.

Would love to know if this helps.

Happy to add additional tests / update documentation, if the initial PR looks good to you.

krrishdholakia avatar Aug 08 '23 18:08 krrishdholakia

I was also searching for cohere support. Adding +1 to the PR Also, if needed help i could code, but the branch need to be clean and tests passing

fabian57fabian avatar Mar 28 '24 22:03 fabian57fabian

Implemented by https://github.com/Future-House/paper-qa/pull/362. Thank you @krrishdholakia for the contribution, we are big fans of LiteLLM!

jamesbraza avatar Sep 11 '24 16:09 jamesbraza