rdnet icon indicating copy to clipboard operation
rdnet copied to clipboard

Robust test

Open LMMMEng opened this issue 1 year ago • 1 comments

Thank you for your solid work.

Could you please provide the code of the robustness test? Thanks a lot!

LMMMEng avatar Oct 13 '24 07:10 LMMMEng

Thank you for your interest!

There is a "robustness evaluation tool" commonly used within our company. Due to company policies, it seems difficult to share it.

dhkim0225 avatar Oct 14 '24 06:10 dhkim0225

@LMMMEng Thank you very much for your interest.

Since we used the internal code (including PyTorch dataloaders for the ImageNet variants) for robustness evaluations, the benchmark code is almost equivalent to a publicly released code like Model Soup.

Let me provide an easy-to-use Jupyter notebook code here for robustness benchmark that can be run standalone as well.

We will be including the robustness benchmark in this repository.

dyhan0920 avatar Oct 15 '24 06:10 dyhan0920

@dyhan0920 Thanks a lot! It's quite helpful.

LMMMEng avatar Oct 15 '24 08:10 LMMMEng