whodb
whodb copied to clipboard
clidey
[FR] Add support for Openai-like API's
Hi ! I have a little enhancement suggestion for Houdini; Houdini already has support for chat-gpt, but today, a lot of AI services online provide "openai-like API's", basically apis almost identical to openai's one, but it points to another service (example : Groq with "https://api.groq.com/openai/v1") what would be great is to add a field (in the same place as the token field) but instead of asking for the token, it asks for the api endpoint.
Thank you for the suggestion and the PR!
If this is identical to ChatGPT endpoint - it should be fairly simple to extend this!
Could you elaborate on the use-case by the way? Would love to get feedback on Houdini's usage with other LLMs.
Hi, i didn't understand this...
If this is identical to ChatGPT endpoint - it should be fairly simple to extend this!
Is a feature to change the endpoint already available ? The use case would basically be to be able to use external services, this would give ability to use : better services in the furture, free services, or even use self hosted ai thats not on the same server than whodb, idk ,
it could look like this :
But if it already exists i'd love to know where the feature is
Hey, apologies for missing this!
That sounds great! I meant like if the API of the Endpoint is of similar definition as ChatGPT then we could extend it to have its own Endpoint. Hoping to get this out soon!
Hey, this PR from @learningpro seems to resolve the OpenAI like endpoints through environment variables: https://github.com/clidey/whodb/pull/252. this should be out in the next release!
I don't see the addition of the custom endpoint from a fresh test tonight using
docker run -it -p 8080:8080 clidey/whodb
So it would have pulled the latest image I believe.
I use a compatible openai endpoint which I would use in lieu of ChatGPT. (1min.ai)
Hey @Node815, apologies on the change. We, unfortunately, had to revert the changes when we moved to Apache License 2.0 (due to lack of consent). We will add similar functionality in the next release. Also, would love to get feedback on our Houdini feature - would you be willing to send us your thoughts at [email protected]?