ROMP icon indicating copy to clipboard operation
ROMP copied to clipboard

Why does the test and evaluation shows different results?

Open jhkim0759 opened this issue 2 years ago • 3 comments

I'm training ROMP model with your code It saves every validation process but, I test the results with "python -m romp.test" code I got the different result as evaluation I think they are same process, do you know why ? Or did I do something wrong?

jhkim0759 avatar May 10 '22 07:05 jhkim0759

Yes, i observe the same thing, which is quite weird. Haven't figured out the reason for now.

Arthur151 avatar May 10 '22 07:05 Arthur151

Thank you. I'll tell you when I find out why.

jhkim0759 avatar May 10 '22 07:05 jhkim0759

I found it!! its because of the 'match_preds_to_gts_for_supervision' argument. In evaluation config the 'match_preds_to_gts_for_supervision' was set to false Thank u.

jhkim0759 avatar May 10 '22 09:05 jhkim0759