ReScience
[Re] Learning with Noisy Labels Revisited: A Study Using Real-World Human Annotations
Original article: Learning with Noisy Labels Revisited: A Study Using Real-World Human Annotations
PDF URL: https://github.com/KlemenVovk/noisy-labels/blob/master/rescience/rescience.pdf Metadata URL: https://github.com/KlemenVovk/noisy-labels/blob/master/rescience/metadata.yaml Code URL: https://github.com/KlemenVovk/noisy-labels Openreview: https://openreview.net/forum?id=GKZ2leags0
Scientific domain: Machine Learning Programming language: Python Suggested editor: @rougier
@ValterH Very sorry for such long delay, for some reasons, I did not see your submission. Is your paper part of the ML Reproducibility Challenge ? If yes, do you have open peer review already?
@rougier No problem. We were under the impression that there was no reproducibility challenge for 2024, so we decided to submit to ReScience C directly.
Ok, and sorry for long delay in my answer, end of year was pretty chaotic. I'll handle your submission.
@ValterH Don't hesitate to notify me here if things are not moving. Else, you can also mail me directly.
@gdetor @mo-arvan @MollyZhang @pena-rodrigo Could you review this submission?
@rougier I am reopening our submission. I added links to the updated article and paper reviews from MLRC.
Ok, are there any public reviews by any chance? [Just realized you added the link to open reviews...]
Ok, are there any public reviews by any chance?
Yes, the reviews are available at https://openreview.net/forum?id=GKZ2leags0
Thanks. Based on these public reviews, I think we can accept directly your paper for publication.
My only two comments concerns the title: [Re] means full replication, [~Re] means partial replication and [¬Re] means not reproducible. Based on your discussion / conclusion, do you prefere to keep [Re] or to use [~Re] ? the other very minor comment is in the text with a lot line returns. Is that intended ?
Thank you for the quick response!
My only two comments concerns the title: [Re] means full replication, [~Re] means partial replication and [¬Re] means not reproducible. Based on your discussion / conclusion, do you prefere to keep [Re] or to use [~Re] ?
I agree that a partial reproduction is more approporiate, hence we will change the name to use [~Re].
the other very minor comment is in the text with a lot line returns. Is that intended ?
I added breaks between paragraphs to replace the line returns.
Both changes are reflected in the updated version of the article: https://github.com/KlemenVovk/noisy-labels/blob/rescience/rescience/rescience.pdf