DGAM-Weakly-Supervised-Action-Localization icon indicating copy to clipboard operation
DGAM-Weakly-Supervised-Action-Localization copied to clipboard

Generate 0 predictions in reproducing the results

Open thss15fyt opened this issue 4 years ago • 5 comments

Hi, thanks for your contribution to this interesting work.

I have downloaded the datasets and set config.DATASET_NAME = 'ActivityNet12' to reproduce the results. However, during the training process, I got the following output with an averaged-mAP of 0.0:

Number of predictions: 0 Warning: No predictions of label XXX were provided.

I do not modify any code of this library. So is there anything missed for reproducing your results? Thanks.

thss15fyt avatar Oct 24 '20 08:10 thss15fyt

Hi, thanks for your interest in our work.

In your case, do you mean there are no predictions for any label? or just for one label?

And is the loss decreasing in training? Is there anything strange in training except for the training-time evaluation?

bfshi avatar Oct 24 '20 09:10 bfshi

Yes, there is no prediction for any label. Actually, I print out the classification score and find all frames are predicted as the background label.

The loss is continually decreasing from 5 to 0.2, after training 500+ epochs. However, the predictions keep empty throughout the time.

thss15fyt avatar Oct 24 '20 10:10 thss15fyt

I just downloaded the code and data, and tried as you said (only change config.DATASET_NAME and nothing else). Everything seems normal. Only in the first 10 epochs there are no predictions, but after that I get positive mAP.

Could you try to change config.IF_DETERMINISTIC to False, and run the code again?

bfshi avatar Oct 24 '20 12:10 bfshi

@bfshi It does not work to set the flag to False. Is it possible that some packages are installed in different versions from the requirements.txt?

thss15fyt avatar Oct 24 '20 13:10 thss15fyt

I just double-checked and seems it's the same version on my server...

bfshi avatar Oct 25 '20 12:10 bfshi