chargrid2d icon indicating copy to clipboard operation
chargrid2d copied to clipboard

high IOU in validation but bad results in test

Open mirko0x5f opened this issue 3 years ago • 3 comments

Hello @thanhhau097 , I tried to train your implementation with custom data, and I'm getting what I consider high values of IOU (80-90%) in validation, but when I try to run the tests I rarely even get a single result (accuracy < 1% on 4 different labels). Do you know what could be causing this? Thank you for open sourcing this. Best, Mirko

mirko0x5f avatar Aug 12 '21 15:08 mirko0x5f

Have you loaded correct checkpoint? If yes, could you please test with validation/train images?

thanhhau097 avatar Aug 12 '21 15:08 thanhhau097

Yes, I loaded the last training checkpoint. I tried with validation images and the result is similar. Very few gets predicted. Thank you for the fast answer!

mirko0x5f avatar Aug 12 '21 15:08 mirko0x5f

I thought there may be some problems with the prediction function. If it's correct, the result of validation images should be good. Good luck!

thanhhau097 avatar Aug 12 '21 15:08 thanhhau097