EMCGCN-ASTE icon indicating copy to clipboard operation
EMCGCN-ASTE copied to clipboard

请问作者设置的随机数种子是多少?我无法在本地运行达到论文中的实验结果。

Open SupritYoung opened this issue 2 years ago • 8 comments

我尝试了多种种子设置,在 4 种数据集上均无法达到论文里测试集的实验效果,请问作者能否分享一下设置的种子,或者只分享最高的就行,1000 应该不是最高的。

SupritYoung avatar Aug 30 '22 01:08 SupritYoung

我尝试了多种种子设置,在 4 种数据集上均无法达到论文里测试集的实验效果,请问作者能否分享一下设置的种子,或者只分享最高的就行,1000 应该不是最高的。

I think the results of the experiment are not only related to random seeds, but also to the machine environment. In my experiment, I set five random seeds, 1000, 2000, 3000, 4000, 5000.

CCChenhao997 avatar Aug 30 '22 07:08 CCChenhao997

Thank you. Excuse me, is the default experiment setup in your code is best and as same as your paper ? I compared them and found no difference.

SupritYoung avatar Sep 02 '22 12:09 SupritYoung

Hello, I verify your conclusion. I run your code in 3 different device, and it's right that the experiment is related to the machine enviroment. 😭 And can you tell me your graphics card type of your device. I wanna to try to run as same as your graphics card.

SupritYoung avatar Sep 03 '22 13:09 SupritYoung

作者不回复我,但是我还是想说,我跑了 10 次,只有 1 次能在res16上能跑到 0.68。。。期待其他同学能够复现该模型,一起交流一下。 image

SupritYoung avatar Sep 27 '22 11:09 SupritYoung

你好,我跑了1次,最好的是0.67070

差不多,作者应该是专门调结果了,说的是平均,其实就是跑了 10 次取最好的。

SupritYoung avatar Oct 24 '22 11:10 SupritYoung

作者不回复我,但是我还是想说,我跑了 10 次,只有 1 次能在res16上能跑到 0.68。。。期待其他同学能够复现该模型,一起交流一下。 image

你好,最近我也在复现该模型,我们可以留下联系方式交流下吗

tongzeliang avatar Nov 08 '22 07:11 tongzeliang

作者不回复我,但是我还是想说,我跑了 10 次,只有 1 次能在res16上能跑到 0.68。。。期待其他同学能够复现该模型,一起交流一下。 image

你好,最近我也在复现该模型,我们可以留下联系方式交流下吗

wx:SupritYoung

SupritYoung avatar Nov 08 '22 08:11 SupritYoung

我用kaggle的GPU跑出来效果比论文还高一点,res14到72了。seed=2000

Little1861 avatar May 25 '23 09:05 Little1861