RISDA icon indicating copy to clipboard operation
RISDA copied to clipboard

Accurate Rate or Error Rate?

Open DemonsHunter opened this issue 2 years ago • 1 comments

I download code in your repository and read it carefully and thoroughly.

I notice that the code keeps the manual random seed the same and sets cudnn.deterministic True. All of this makes sure the result is asthe same as you report in the paper. Specifically, when Imbalance Factor is 20, the result is 41.33.

However, according to the code, 41.33 is calculated as accuracy rate, while in your paper, 41.33 is reported as error rate. The 2 metrics are opposite aspect of an algo, which makes me puzzled.

Could you give an explanation?

DemonsHunter avatar Mar 30 '22 10:03 DemonsHunter

Well, the accuracy is calculated in the code. The error rate reported in the paper is calculated by manually subtracting the accuracy from 100.

For example, when Imbalance Factor is 20, according to the code, the result of code accuracy is 58.67, while the error rate reported in the paper is 100-58.67= 41.33.

For another example, when Imbalance Factor is 200, according to the code, the result of code accuracy is 44.76, while the error rate reported in the paper is 100-44.76= 55.24.

xiaohua-chen avatar Mar 31 '22 07:03 xiaohua-chen