Verba icon indicating copy to clipboard operation
Verba copied to clipboard

Integration of Groq LPU Inference generation (#140)

Open symdec opened this issue 1 year ago • 3 comments

Following this issue : https://github.com/weaviate/Verba/issues/140

  • Add GroqGenerator class, taking inspiration from CohereGenerator and others (from the 2.0 release)
  • Update managers.py to include this new generator
  • Update README to precise the availability of this Groq Generation feature + section to recommend using the environment variable before launching Verba (to have updated models list)

The generation has been successfully tested locally with various Groq models :

  • using the GROQ_API_KEY variable set in the .env file before the launch
  • using no .env file and providing the API key in the graphical config interface

symdec avatar Sep 08 '24 18:09 symdec

To avoid any confusion in the future about your contribution to Weaviate, we work with a Contributor License Agreement. If you agree, you can simply add a comment to this PR that you agree with the CLA so that we can merge.

beep boop - the Weaviate bot 👋🤖

PS:
Are you already a member of the Weaviate Slack channel?

weaviate-git-bot avatar Sep 09 '24 10:09 weaviate-git-bot

I agree with the CLA.

symdec avatar Sep 09 '24 11:09 symdec

Thanks a lot for the PR, I'll have a look 🚀

thomashacker avatar Sep 13 '24 03:09 thomashacker