evidently icon indicating copy to clipboard operation
evidently copied to clipboard

RMSE metric in RegressionQualityMetric is wrong

Open tbaptista opened this issue 1 year ago • 3 comments

Hi,

The RegressionQualityMetric contains a metric value for RMSE. However, the calculation of the metric is wrong and is actually computing the MSE, not the RMSE.

The calculation is using scikit-learn mean_squared_error function, and the default for this function is to output the MSE. To output the RMSE, we need to pass the parameter squared=False.

Using version 0.3.3.

tbaptista avatar Jul 10 '23 18:07 tbaptista

Hi @tbaptista, thanks for reporting!

Could you try building Evidently from main and see if the issue persists?

This bug should have been fixed recently but is not yet released in the package.

elenasamuylova avatar Jul 11 '23 13:07 elenasamuylova

Hi @elenasamuylova,

Thank you for the quick reply. Yes, I can confirm that the issue is solved in the most recent code in main. Waiting for the release then.

tbaptista avatar Jul 11 '23 15:07 tbaptista

Thanks for checking @tbaptista! This will be published next week together with the next release.

elenasamuylova avatar Jul 11 '23 17:07 elenasamuylova