cog
cog copied to clipboard
Provide OpenAI compatible HTTP endpoints
Currently the cog http server provides a REST interface with the "/predictions" endpoint. This is a request to provide OpenAI compatible endpoints. The goal would be to use a cog as a drop-in replacement for OpenAI and compatible models. Ideally, this would include embeddings and a chat interface (with and without streaming).
have the same need