elenasamuylova
elenasamuylova
Hi @nagasaipureti, I am afraid we cannot give a precise answer here. The performance varies based on your infrastructure, the number of rows/columns, and the exact metrics used (e.g., some...
Hi @kf-rahman If you run LLM models in production, you can use Evidently to evaluate and monitor input text data quality, text data drift, and embedding drift. We do not...
Hi @nfrvnikita, we recently released: - A complete example integration of Evidently with Postgres as a metrics destination: https://github.com/evidentlyai/evidently/tree/main/examples/integrations/postgres_grafana_batch_monitoring - We also simplified JSON/Python dictionary output and introduced parameters to...
Hi @danilyef, thanks for the feature request! We currently have: * `TestF1ByClass(label='classN') ` * `TestF1Score()` So it is already possible to test F1 by class. To double-check, you also would...
Hi @elutins, The `TestShareOfOutListValues` does not accept this parameter. I double-checked the docs (the Test is listed under the [Data Quality group](https://docs.evidentlyai.com/reference/all-tests#data-quality)). It appears to be reflected correctly: For this...
Hi @elutins, I am afraid the test explicitly checks for all new values, and this includes "unknowns" or "nulls". Possible workarounds are: - Make sure the reference dataset includes missing...
Thanks a lot for raising the issue @samuelamico! It is a mistake in the documentation. By default, the test does use the reference (to learn the reference value ranges) but...
Hi @anh-le-profinit, It is possible to configure custom conditions for all tests. Here is the documentation: https://docs.evidentlyai.com/user-guide/tests-and-reports/custom-test-suite#3.-set-test-conditions For example, if you want the test to fail if more than 10%...
Hi @anh-le-profinit, It works exactly the same - you can pass custom conditions to any Evidently Test. For example, if you want the test to fail if share of missing...
In this case you will set the Test condition without comparing it to the reference - the Test will simply check if the total share of missing values in the...