Validation set for CMNIST

[googlebaba]

Dear authors, I want to know the data setting of validation set for CMNIST. Does the validation set have the same bias degree with training set? Thanks in advance.

[leebebeto]

Thanks for your interest in our work. Like you asked, the bias degree of the validation set is same as that of the training set.

[googlebaba]

Thanks for the reply. From the code, it seems that you directly pick the best test results without using the validation set, correct?

[leebebeto]

We used the same bias severity as used in the unbiased test set for tuning the hyper parameters. Thank you.

[googlebaba]

Thanks, so, I wonder what's the function of the validation set?

[leebebeto]

We used the validation set for evaluating the classification accuracy on bias-aligned samples mainly. Thank you!