auditor icon indicating copy to clipboard operation
auditor copied to clipboard

Explanation of the REC and RROC curves

Open Nehagupta90 opened this issue 2 years ago • 2 comments

Hello

Please if you could explain/interpret the x-axis of the REC curve plot and x-axis & y-axis of the RROC curve plot. Unfortunately not a thorough explanation has been provided in the paper about the auditor package.

Nehagupta90 avatar Feb 18 '22 22:02 Nehagupta90

Hello,

The x-axis on the REC curve plot is error tolerance which is the value of residual error that can be made by the model and we still consider the model's prediction to be the correct one. The larger the value on the x-axis, the larger model residuals we allow.

In the arxiv we have published also extended version of the paper with the descriptions of all methods https://arxiv.org/pdf/1809.07763.pdf In Section 4.3.5 RROC Curve Plot you can find formulas for x- and y-axis in the RROC plot.

agosiewska avatar Feb 21 '22 08:02 agosiewska

Thank you Alicja

Is there any specific value of error tolerance which could be considered as a threshold value and after it exceeds, we cannot accept the error ?

I mean if there are values from 0-6 on x-axis, the accuracy at '0' is unbiased accuracy and the accuracy at '6' is highly biased, so what should the range (e.g. 0-3) which we consider as a threshold ?

Regards

On Mon, Feb 21, 2022 at 9:56 AM Alicja Gosiewska @.***> wrote:

Hello,

The x-axis on the REC curve plot is error tolerance which is the value of residual error that can be made by the model and we still consider the model's prediction to be the correct one. The larger the value on the x-axis, the larger model residuals we allow.

In the arxiv we have published alsan extended version of the paper with the descriptions of all methods https://arxiv.org/pdf/1809.07763.pdf In Section 4.3.5 RROC Curve Plot you can find formulas for x- and y-axis in the RROC plot.

— Reply to this email directly, view it on GitHub https://github.com/ModelOriented/auditor/issues/158#issuecomment-1046618584, or unsubscribe https://github.com/notifications/unsubscribe-auth/AN2ZZ2MA66MBESFRXY6WCHDU4H423ANCNFSM5OZHDSDQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you authored the thread.Message ID: @.***>

Nehagupta90 avatar Feb 21 '22 12:02 Nehagupta90