Microsoft Azure

[olimarferraz]

 How do I integrate this package with my Azure environment? Is there an easy way to use the custom endpoint for my model?

I am using LLPhant in a Laravel project and so far everything is going very well, but due to data isolation reasons, I need to work with the model hosted in our Azure Cloud.

[MaximeThoonsen]

Hey @olimarferraz !

it should be easy because you can pass any client you want. see the mistral class for one example.

$clientFactory = new Factory();

$config->client = $clientFactory
                ->withApiKey($apiKey)
                ->withBaseUri(self::BASE_URL)
                ->make();

Does it help you?

[stef157]

Hi, I think this doesn't work with the embedded models. Any suggestions on how to deal with it ?

Thanks

[joostvanhoof]

@stef157 @olimarferraz did you get this working for both chat and embeddings? Looks like setting OPENAI_BASE_URL in the ENV file should make this work?