CurveNet icon indicating copy to clipboard operation
CurveNet copied to clipboard

could not reproduce classification results

Open rabbiahassan opened this issue 4 years ago • 4 comments

Hello ! Your work is very interesting.Thanks for sharing. I trained and tested the classification network as per the instructions given by you on github page but results are far from what you have posted in the paper. I would really ppriciate if you can comment on it. image

rabbiahassan avatar Oct 12 '21 03:10 rabbiahassan

Hi, 0.927 classification accuracy is really strange, the plain backbone (even DGCNN) performs much better than this. Can you please post your training log? That will help identify the problem. Thanks!

tiangexiang avatar Oct 12 '21 03:10 tiangexiang

Hi, 0.927 classification accuracy is really strange, the plain backbone (even DGCNN) performs much better than this. Can you please post your training log? That will help identify the problem. Thanks!

Thanks a lot for the reply.I am attaching the training log generated by the network in run.log file. run.log

rabbiahassan avatar Oct 12 '21 03:10 rabbiahassan

I have re-evaluated the repo on two different machines, both got consistent results (0.9371 and 0.9363).

Can you please doublecheck there are not any changes to the original code?

If the code is indeed unmodified, can you upgrade/downgrade pytorch to 1.4.0 (which is used in my machines) and try again?

Please let me know if the problem still exists.

tiangexiang avatar Oct 12 '21 12:10 tiangexiang

Thanks a lot for reply.I will test on an other machine and will let you know.For record I didnt modify code at all.

rabbiahassan avatar Oct 14 '21 04:10 rabbiahassan