ChatGPT.nvim icon indicating copy to clipboard operation
ChatGPT.nvim copied to clipboard

Published 20 hours ago • verified publisher icon jackMort

Groq is too fast

Open Aman9das opened this issue 1 year ago • 4 comments

The output from https://console.groq.com gets cut off due to the speed of inference.

image

Aman9das avatar Mar 22 '24 00:03 Aman9das

How do you setup groq with this plugin?

anandkumar89 avatar Apr 05 '24 14:04 anandkumar89

using environment variables OPENAI_API_HOST and OPENAI_API_KEY

Aman9das avatar Apr 05 '24 14:04 Aman9das

how you have set model ?

ehsan2003 avatar Jul 02 '24 05:07 ehsan2003

Personnaly I ended up making a quick and dirty docker compose to run litellm and highjack request. That allowed me to use Claude sonnet 3.5 as well as online searching models.

thiswillbeyourgithub avatar Jul 02 '24 05:07 thiswillbeyourgithub