laravel
laravel copied to clipboard
Allow configuration of base uri
This is very useful to use drop in replacements of the openai-api for local models.
Hi @grafst
Thank you for your PR.
It looks like this is introducing a breaking change, because it will fail for all existing users not having the base_uri in their configuration file.
I think this can be fixed, by making the default null and only set the baseUri if a configuration exists and is not null.
And in my opinion there is no need to validate if the base uri is a string. Maybe we can just enforce a string casting.
yes you are totally right, it should just ignore if the config is not present. Oh and really sorry I didn't see the other PR before :(
Is this now better?
Hi, Any update on getting this resolved and merged? or a new PR should be created?
So we still do not have any option to pass a custom URL for self-hosting LLM? Or just have to pass as an HTTP request?
Yes I will look into it soon.
On February 17, 2024, Markus Hilsenbeck @.***> wrote:
So we still do not have any option to pass a custom URL for self- hosting LLM? Or just have to pass as an HTTP request?
— Reply to this email directly, view it on GitHub https://github.com/openai-php/laravel/pull/72#issuecomment-1950243983, or unsubscribe <https://github.com/notifications/unsubscribe- auth/ACAUED23YVD2ZCU4SSAYOETYUDIHHAVCNFSM6AAAAAA7N5TJZSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNJQGI2DGOJYGM>. You are receiving this because you were mentioned.Message ID: <openai- @.***>
I would also love to see this added. Am hoping to use this along with openrouter.ai to get access to many different models from one interface.