Contrastive-Clustering icon indicating copy to clipboard operation
Contrastive-Clustering copied to clipboard

Low Accuracy Than Reported

Open wangtuo13 opened this issue 3 years ago • 12 comments

I run the code in win10+python3.7+pytorch1.8.1+cu111 and get 21% accuracy on Cifar10 dataset.

wangtuo13 avatar May 26 '21 15:05 wangtuo13

How many epochs have you trained?

Yunfan-Li avatar May 27 '21 01:05 Yunfan-Li

i also have this problem , i trained with 1000 epoch as the same as you. please give some suggestion,thank you very much!

haoweiclouds1 avatar Nov 29 '21 02:11 haoweiclouds1

results as follows: ( run cluster.py) Features shape (60000,) NMI = 0.1276 ARI = 0.0685 F = 0.1795 ACC = 0.2311

haoweiclouds1 avatar Nov 29 '21 02:11 haoweiclouds1

Please make sure that you reload the model trained for 1000 epoch. Perhaps the model at epoch 0 is loaded for clustering.

Yunfan-Li avatar Nov 29 '21 02:11 Yunfan-Li

thank you i will try again

haoweiclouds1 avatar Nov 29 '21 02:11 haoweiclouds1

sorry ,I return to ask you some questions.

I have trained for 1000 epoch and the model has saved,

how can i load in cluster.py in your code (eg :i find the path i have saved : Contrastive-Clustering-main/save/CIFAR-10/checkpoint_990.tar)

thank you very much!

haoweiclouds1 avatar Nov 29 '21 02:11 haoweiclouds1

Changing the ''start epoch'' number in the config file to 990 will do.

Yunfan-Li avatar Nov 29 '21 02:11 Yunfan-Li

hh thank you ,i find !

haoweiclouds1 avatar Nov 29 '21 02:11 haoweiclouds1

your work is very wonderful!!

haoweiclouds1 avatar Nov 29 '21 02:11 haoweiclouds1

Thank you!

Yunfan-Li avatar Nov 29 '21 02:11 Yunfan-Li

您好,可以先试一下用release的模型测试看下结果是否正确,然后确保您没有改动训练的代码和config中的超参数,重新训练看下结果,因为软硬件环境的不同,根据目前的反馈可能有1-2个点的偏差,但是0.5一定是哪里出了问题。

Yunfan-Li avatar Nov 29 '21 03:11 Yunfan-Li

好的 我试试 感谢

haoweiclouds1 avatar Nov 29 '21 04:11 haoweiclouds1