cifar-10-100n icon indicating copy to clipboard operation
cifar-10-100n copied to clipboard

Reproduction of the performance on "worst" label of "CE".

Open Seojin-Kim opened this issue 1 year ago • 0 comments

Hello,

I'm trying to reproduce the performance of "CE" in the paper.

In "worst" label noise, the paper reports the test accuracy of 77.69 (in CIFAR-10-N).

However, when I run the provided code on my machine, the last test epoch accuracy is only 67.89 and it seems overfitting occurs to the training noisy labels.

Did you use validation set for evaluation? Or could you point out if I'm missing something?

Also, there's a discrepancy on the learning rate scheduling between the paper and code.

Learning rate decay is applied in 60th epoch in the code, but the paper says that it is applied in 50th epoch.

Could you check about it?

Thank you.

image

Seojin-Kim avatar Sep 13 '22 18:09 Seojin-Kim