auditor
auditor copied to clipboard
Explanation of the REC and RROC curves
Hello
Please if you could explain/interpret the x-axis of the REC curve plot and x-axis & y-axis of the RROC curve plot. Unfortunately not a thorough explanation has been provided in the paper about the auditor package.
Hello,
The x-axis on the REC curve plot is error tolerance which is the value of residual error that can be made by the model and we still consider the model's prediction to be the correct one. The larger the value on the x-axis, the larger model residuals we allow.
In the arxiv we have published also extended version of the paper with the descriptions of all methods https://arxiv.org/pdf/1809.07763.pdf In Section 4.3.5 RROC Curve Plot you can find formulas for x- and y-axis in the RROC plot.
Thank you Alicja
Is there any specific value of error tolerance which could be considered as a threshold value and after it exceeds, we cannot accept the error ?
I mean if there are values from 0-6 on x-axis, the accuracy at '0' is unbiased accuracy and the accuracy at '6' is highly biased, so what should the range (e.g. 0-3) which we consider as a threshold ?
Regards
On Mon, Feb 21, 2022 at 9:56 AM Alicja Gosiewska @.***> wrote:
Hello,
The x-axis on the REC curve plot is error tolerance which is the value of residual error that can be made by the model and we still consider the model's prediction to be the correct one. The larger the value on the x-axis, the larger model residuals we allow.
In the arxiv we have published alsan extended version of the paper with the descriptions of all methods https://arxiv.org/pdf/1809.07763.pdf In Section 4.3.5 RROC Curve Plot you can find formulas for x- and y-axis in the RROC plot.
— Reply to this email directly, view it on GitHub https://github.com/ModelOriented/auditor/issues/158#issuecomment-1046618584, or unsubscribe https://github.com/notifications/unsubscribe-auth/AN2ZZ2MA66MBESFRXY6WCHDU4H423ANCNFSM5OZHDSDQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you authored the thread.Message ID: @.***>