Emmanuel Letremble

icon indicating an email [email protected]

icon location Paris

Results 3 issues of Emmanuel Letremble

Results are not persisted even with a volume and PROMPTFOO_SHARE_STORE_TYPE=filesystem

4 comment

Hello, I deployed promptfoo on a VM using a Docker-compose and the pre-built image available at ghcr.io/promptfoo/promptfoo:main ![promptfoo_persistence_01 png](https://github.com/user-attachments/assets/c97d6d27-cbe7-47fe-8a43-c5c2de73ba06) ![promptfoo_persistence_02 png](https://github.com/user-attachments/assets/d5678dba-cd2b-4b3d-bf7b-784a4364aea0) However, if I run several evaluations and then explore...

bug
Open Source

Can't get the 'assert' index from within a custom_metric script (and hence can't access the current assert variables)

I am passing several extra parameters (such as threshold, rouge_mode etc) when declaring my custom metrics in the promptfooconfig.yml, and I'm trying the retrieve them from the custom metric script....

Open Source

fix: update Azure Provider with openai models

The current implementation of the Azure provider works with some models but not with some others. Some will use : > https://**YOUR_DEPLOYMENT_NAME.YOUR_REGION_NAME.models.ai.azure.com/v1**/chat/completions?api-version=YOUR_API_VERSION > headers = {"Content-Type": "application/json", "**Authorization**": self.api_key} And...