SAGPool icon indicating copy to clipboard operation
SAGPool copied to clipboard

Reproducibility of Table 3

Open SilvioGiancola opened this issue 5 years ago • 9 comments

Hi,

I am running your code several time on the DD dataset and obtain different results than the one you present on Table 3 of your paper. In particular I run 20 times this experiment, estimate the average and std but find out that the training is very random, with the std rising up to +-10%. Note that I used the same hyperparameters you provide in your paper and your google sheet (see issue #2). I also tried with the ReduceLROnPlateau scheduler for the LR, but still have an std up to 5%. How did you select your seed and how come there is such variation?

Thank you for your support,

Best,

SilvioGiancola avatar Jul 17 '19 09:07 SilvioGiancola