SlowFastNetworks icon indicating copy to clipboard operation
SlowFastNetworks copied to clipboard

result in ucf101

Open qichenghan666 opened this issue 6 years ago • 13 comments

I trained the model in ucf101, after 70 epoch, the top 1 accuracy is 73.3%, the top 5 accuracy is 95.7% in training data, is this a normal result?

qichenghan666 avatar Jul 26 '19 01:07 qichenghan666

I trained the model in ucf101, after 70 epoch, the top 1 accuracy is 73.3%, the top 5 accuracy is 95.7% in training data, is this a normal result?

Hi, I looks good acoording to the paper but when using inference how did it work?

HorusMaster avatar Aug 11 '19 16:08 HorusMaster

I also trained the model on ucf101 dataset. At first, I used the default hyperparameters which the author gave. Then I got the 73.50% of top 1 accuracy. Afterwards, I changed the learning schedule from StepLR to ReduceLROnPlateau and hyperparameters such as learning rates, weight decay, and so on. The top 1 accuracy became about 94%.

Therefore, I think we should use our own hyperparameters and learning schedule so that we could get better results on our own datasets.

tomanick avatar Sep 17 '19 01:09 tomanick

@tomanick how did you search for the hyperparameters? Would you mind sharing the ones that have worked for you?

patykov avatar Sep 17 '19 17:09 patykov

@patykov Maybe there was no standard answer for hyperparameters. I often found the better hyperparameters by trial and error. On UCF101 dataset, I used learning rate=0.001, weight decay = 0.0005, batch size=16, and clip length=64. The learning schedule which I used was ReduceLROnPlateau. In addition, I also found used AdamW as the optimizer could get better results than SGD sometimes.

Finally, maybe there would be much better hyperparameters than I used. Just give it a try and maybe you would find a surprise. Good luck!

tomanick avatar Sep 18 '19 03:09 tomanick

@tomanick did you find a way to set the temporal stride τ used on input frames? in the paper they used values equal to 16, 8, ...

MStumpp avatar Sep 21 '19 12:09 MStumpp

@MStumpp do you want to set the temporal stride like 16, 8 ? you can look into slowfastnet.py/class slowfast / forward find code like this slow = self.SlowPath(input[:, :, ::16, :, :], lateral) input is a 5D tensor which have dim like [batch ,channel,temporal, h,w] ,so once you have a input with 64 frames, the temporal axis is 64 and you can use ::16 ,that means you choose 4 frames in 64 frames with stride 16

sdjsngs avatar Oct 12 '19 08:10 sdjsngs

@tomanick @qichenghan666 @HorusMaster Did you guys try to validate this model on datasets from the paper (Kinetics, Charades or anything else)? Does the accuracy look representative of the paper?

anuar12 avatar Oct 16 '19 18:10 anuar12

I trained the model in ucf101, after 70 epoch, the top 1 accuracy is 73.3%, the top 5 accuracy is 95.7% in training data, is this a normal result?

What is the accuracy of your validation sets, I hope you can tell me, thank you

luwanglin avatar Jan 06 '20 15:01 luwanglin

@tomanick The top 1 accuracy became about 94% is the train accuracy for training from scratch ? And since you use ReduceLROnPlateau as your lr_schedular, how did you get the validation set from ucf101? The offical splits are three train/test splits, Or you just give the train_ loss to the ReduceLROnPlateau? i used did a wrong split to get train/validation/test and the test accuracy is 91% training from scratch , and once i fix this spilt the top-1 accuracy is just 65, which is close to the facebook-slowfast i sincerely look forward to your reply !!!

sdjsngs avatar May 07 '20 03:05 sdjsngs

@HorusMaster did you get the inference code at last ?such as how to detect a small single video?

yangjinghit avatar Aug 13 '20 06:08 yangjinghit

I trained the model in ucf101, after 70 epoch, the top 1 accuracy is 73.3%, the top 5 accuracy is 95.7% in training data, is this a normal result? I want to confirm your experimental results which is the experiment of ucf101 training from scratch on slowfast, As you said "after 70 epoch, the top 1 accuracy is 73.3%, the top 5 accuracy is 95.7% in training data", which author's implementation are you using , have any changes been made?

Weed-eat-meat avatar Sep 07 '20 03:09 Weed-eat-meat

I trained the model in ucf101, after 70 epoch, the top 1 accuracy is 73.3%, the top 5 accuracy is 95.7% in training data, is this a normal result? I want to confirm your experimental results which is the experiment of ucf101 training from scratch on slowfast, As you said "after 70 epoch, the top 1 accuracy is 73.3%, the top 5 accuracy is 95.7% in training data", which author's implementation are you using , have any changes been made?

用好一点的显卡,然后精度就提高了哈哈哈哈

wangpanpan666 avatar Jul 05 '22 09:07 wangpanpan666

Hai @wangpanpan666 @r1c7

after completion of training on how to test model ???

can anyone provide an inference code it's very useful for me

Thanks

vsumm avatar Aug 26 '22 10:08 vsumm