llama-cpp-python
llama-cpp-python copied to clipboard
Openplayground Suport
trafficstars
Support for Nat Friedman's Openplayground project via the OpenAI api server.
You can currently test this with
docker run --rm --name openplayground -e OPENAI_API_BASE=<API-URL> -p 5432:5432 --volumne openplayground:/web/config natorg/openplayground
However this currently does not work, I suspect it has to do with the model value and endpoint expecting a hardcoded openai model name.
This should be fixable via #17 and #39