Deep-SVDD-PyTorch icon indicating copy to clipboard operation
Deep-SVDD-PyTorch copied to clipboard

about results(Average AUCs in % with StdDevs (over 10 seeds) )

Open tommying opened this issue 5 years ago • 4 comments

Hi, I am mystified by this (Average AUCs in % with StdDevs (over 10 seeds) ).

Do you mean to get the average results over 10 seeds. If then, what should be the range of seeds? (1 - 10 ? or 10 -20 ?). The results varied widely, because of different seed settings. Can you help me with this question? Thank you.

tommying avatar Jan 06 '20 06:01 tommying

I have the same question as well! If someone from the team could provide any help, that would be great!

dimimal avatar Apr 09 '20 00:04 dimimal

This is also my question and I think its related to collect_results.py in the utils folder. and I have another question: If we set seed to any number except -1, the result must not change by rerunning. however when I use preparing the results of both pretraining and training change widely. it worth mentioning that if you set pretraining False, the network is trained without any pre-trained weights and the result of many times training are the same for the specific seed value. (of course except -1) Anybody knows why seed does not work for autoencoder?

omid-ghozatlou avatar Nov 30 '21 11:11 omid-ghozatlou

According to collect_results.py range of seed is 1-10

omid-ghozatlou avatar Jan 31 '22 11:01 omid-ghozatlou

I also have such problems. Should the author publish the seeds, otherwise the training results may deviate due to different seeds.

Longchao1047027852 avatar Jun 29 '23 01:06 Longchao1047027852