evidently
evidently copied to clipboard
RMSE metric in RegressionQualityMetric is wrong
Hi,
The RegressionQualityMetric contains a metric value for RMSE. However, the calculation of the metric is wrong and is actually computing the MSE, not the RMSE.
The calculation is using scikit-learn mean_squared_error function, and the default for this function is to output the MSE. To output the RMSE, we need to pass the parameter squared=False
.
Using version 0.3.3.
Hi @tbaptista, thanks for reporting!
Could you try building Evidently from main and see if the issue persists?
This bug should have been fixed recently but is not yet released in the package.
Hi @elenasamuylova,
Thank you for the quick reply. Yes, I can confirm that the issue is solved in the most recent code in main. Waiting for the release then.
Thanks for checking @tbaptista! This will be published next week together with the next release.