video-classification icon indicating copy to clipboard operation
video-classification copied to clipboard

drop probability

Open cowarder opened this issue 4 years ago • 5 comments

Did you use dropout while training? I noticed that all of the three models, you set 'dropout_p=0.0', any reason?

cowarder avatar Aug 13 '20 09:08 cowarder

Zhaoguo Wang [email protected]于2020年8月13日 周四18:52写道:

Did you use dropout while training? I noticed that all of the three models, you set 'dropout_p=0.0', any re ason?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/HHTseng/video-classification/issues/31, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKS6G4GJUP5UYABG2FYLR2DSAOZXVANCNFSM4P6EQAPA .

LolBeginner avatar Aug 13 '20 10:08 LolBeginner

I have been playing with this model for a while and training models, initially I had it on 0 and now changed it to default value which is 0.3. My model with the custom data introduced overfits after a number of epcohs so changing it to 0.3 has helped.

a-hassanzadeh avatar Aug 14 '20 14:08 a-hassanzadeh

I have overfitting too! I played ResRCNN model with my custom dataset(3 number predict, 5000 videos, 1000 classes). if no pretrained parameter, loss doesn't decrease, if initialized with UCF101 parameter, overfitting enve happen from the first epoch(train loss decrease, val loss increase). Except for dropout prob, did you change any other parameters to relieve overfitting? thanks!

cowarder avatar Aug 16 '20 14:08 cowarder

5000 videos and 1000 classes means 5 videos per class? I wonder if the model is learning anything? I am working with 2000 videos and 2 classes and the best I can get is 80% accuracy. I think you might be expecting too much from the model.

a-hassanzadeh avatar Aug 17 '20 02:08 a-hassanzadeh

5000 videos and 1000 classes means 5 videos per class? I wonder if the model is learning anything? I am working with 2000 videos and 2 classes and the best I can get is 80% accuracy. I think you might be expecting too much from the model.

i have a similar setting with 1900 videos and 2 classes, i cant get the validation acc to increase beyond 55%, any suggestions for parameters you have tweaked

shumailaahmed avatar Aug 14 '21 17:08 shumailaahmed