OpenLLM
OpenLLM copied to clipboard
bentoml
Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.
Results
151
OpenLLM issues
Sort by
recently updated
recently updated
newest added
### Feature request Based on what I see in the README: > **The API key**: The API key used for client authentication. This is optional. Anyhow, there is no documentation...
