AtheeSouhait

Made it working with my Azure openai deployment, you can test: [https://github.com/AtheeSouhait/fabric/tree/AtheeSouhait-AzureOpenAIonCLI](https://github.com/AtheeSouhait/fabric/tree/AtheeSouhait-AzureOpenAIonCLI) New environment variables must contain: AZURE_OPENAI_API_KEY AZURE_OPENAI_ENDPOINT AZURE_OPENAI_API_VERSION AZURE_OPENAI_MODEL for example: export AZURE_OPENAI_API_VERSION=2024-02-15-preview export AZURE_OPENAI_ENDPOINT=https://yourdeploymentendpoint.openai.azure.com/ export AZURE_OPENAI_MODEL=myGPT4-32k export...

Hi @stefanstranger , indeed the update don't modify output of --listmodel so it is not included in the list. But your setting automaticaly uses your AZURE open ai model. By...

@stefanstranger did you get [my repo's code](https://github.com/AtheeSouhait/fabric/tree/main)? because I can"t see my changes any more in the official version. Or you can see what I changed in the utils.py file...

Not working when I use --stream but working without.  Is it working when you use openai and not azure Open ai (comment the AZURE_OPENAI_API_KEY of env) ?

Thanks @MrPewPewLaser, @stefanstranger : I also re-tested : resinstallation of fabric from https://github.com/danielmiessler/fabric (cloned, put my utils.py, and continue all installation steps + add Azure environment variables). And after the...

@stefanstranger @MrPewPewLaser Great, I'm working on a dockerfile to ease the installation, setup, and the usage. I let you know.

Hi, this is a lead but I can't test it for now: each model needs a particular message structure, for example for **Mistral** models, it is like this: {System}[INST]{User}[/INST]{Assistant} **for...

Hi, check this: [https://github.com/danielmiessler/fabric/issues/179](https://github.com/danielmiessler/fabric/issues/179) I made a dev that adds Azure Open AI.