laravel icon indicating copy to clipboard operation
laravel copied to clipboard

Allow configuration of base uri

Open grafst opened this issue 2 years ago • 6 comments
trafficstars

This is very useful to use drop in replacements of the openai-api for local models.

grafst avatar Nov 16 '23 10:11 grafst

Hi @grafst

Thank you for your PR.

It looks like this is introducing a breaking change, because it will fail for all existing users not having the base_uri in their configuration file. I think this can be fixed, by making the default null and only set the baseUri if a configuration exists and is not null.

And in my opinion there is no need to validate if the base uri is a string. Maybe we can just enforce a string casting.

gehrisandro avatar Nov 16 '23 22:11 gehrisandro

yes you are totally right, it should just ignore if the config is not present. Oh and really sorry I didn't see the other PR before :(

Is this now better?

grafst avatar Nov 17 '23 08:11 grafst

Hi, Any update on getting this resolved and merged? or a new PR should be created?

Xinecraft avatar Feb 07 '24 16:02 Xinecraft

So we still do not have any option to pass a custom URL for self-hosting LLM? Or just have to pass as an HTTP request?

debjit avatar Feb 17 '24 16:02 debjit

Yes I will look into it soon.

On February 17, 2024, Markus Hilsenbeck @.***> wrote:

So we still do not have any option to pass a custom URL for self- hosting LLM? Or just have to pass as an HTTP request?

— Reply to this email directly, view it on GitHub https://github.com/openai-php/laravel/pull/72#issuecomment-1950243983, or unsubscribe <https://github.com/notifications/unsubscribe- auth/ACAUED23YVD2ZCU4SSAYOETYUDIHHAVCNFSM6AAAAAA7N5TJZSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNJQGI2DGOJYGM>. You are receiving this because you were mentioned.Message ID: <openai- @.***>

grafst avatar Feb 18 '24 05:02 grafst

I would also love to see this added. Am hoping to use this along with openrouter.ai to get access to many different models from one interface.

giltotherescue avatar Mar 05 '24 21:03 giltotherescue