How to use a Groq API key?

[robert-winkler]

Hi, I'm running an Open WebUI/ Ollama server, but for 'real-time' work, they are usually too slow.

In contrast, Groq https://groq.com/ provides high-speed access to open AI models and is compatible with OpenAI. For low-intensity use, the free tokens are sufficient.

Is there a way to use ShellGPT with the Groq API?

Best, Robert

[sestren]

Hi, I'm using the following to use ShellGPT with the Groq API: in ~/.config/shell_gpt/.sgptrc, I changed the following:

OPENAI_API_KEY=<Groq API Key>
API_BASE_URL=https://api.groq.com/openai/v1
DEFAULT_MODEL=<Groq model I want to use>

Hope it helps.