[LLM] Wrapper for Forefront AI API

[vertinski]

It would be great if we had a LLMs wrapper for Forefront AI API. They have a selection of open source LLMs accessible, such as GPT-J and GPT-NeoX.

[batmanscode]

Fwiw goose.ai (GPT-J, Neo etc) uses OpenAI API. They have a few extra parameters that'll be nice to have with Langchain but for the most part I think it should just work out of the box

[solyarisoftware]

BTW: https://langchain.readthedocs.io/en/latest/modules/llms/integrations/huggingface_hub.html

[batmanscode]

BTW: https://langchain.readthedocs.io/en/latest/modules/llms/integrations/huggingface_hub.html

I wonder if this method can be used to access bloom/bloomz via petals

https://github.com/bigscience-workshop/petals

[dosubot[bot]]

Hi, @vertinski! I'm Dosu, and I'm helping the LangChain team manage their backlog. I wanted to let you know that we are marking this issue as stale.

From what I understand, you opened this issue requesting a wrapper for the Forefront AI API to simplify the usage of their open source LLMs like GPT-J and GPT-NeoX. In the comments, batmanscode mentioned that goose.ai uses the OpenAI API and suggested that it should work with Langchain out of the box. solyarisoftware also provided a link to the Langchain documentation for integrating with Hugging Face Hub, which might help you access bloom/bloomz via petals.

Before we close this issue, we wanted to check if it is still relevant to the latest version of the LangChain repository. If it is, please let us know by commenting on the issue. Otherwise, feel free to close the issue yourself or it will be automatically closed in 7 days.

Thank you for your contribution to the LangChain repository!