MIRNet icon indicating copy to clipboard operation
MIRNet copied to clipboard

Questions regarding the SIDD dataset split

Open kts707 opened this issue 10 months ago • 2 comments

Hi,

Thanks for the great work!

I am a little bit confused with how the SIDD validation set images are generated. Did you take the Validation .mat files from SIDD benchmark here (as shown in the screenshot below), and then convert them to image patches as described in #12?

In other words, the validation image patches on your Google Drive should be the same content as these .mat files, and they do not have any overlap with the actual training data? Some further clarifications on the dataset split would be super helpful. Much appreciated!

SIDD

kts707 avatar Aug 13 '23 12:08 kts707

For the Validation set we extract the images from the mat files. There is no overlap between the train and val set.

adityac8 avatar Aug 13 '23 15:08 adityac8

Thanks for the quick reply!

I also noticed that in your later work such as in MPRNet, MIRNetv2, and Restormer, you have a validation set and a test set here. It seems that the validation images are the same ones as in this repo, and the test set has the validation .mat files from SIDD website. Are they essentially the same content, except that val set are the cropped patches of the test set (.mat files)?

kts707 avatar Aug 14 '23 03:08 kts707