trx icon indicating copy to clipboard operation
trx copied to clipboard

Performance on UCF101 is lower than the reported

Open Jamine-W opened this issue 3 years ago • 8 comments

Thanks for sharing your code. I use your code to train on UCF101 with the suggested hyper-parameters (i.e., lr=0.001, trans_linear_out_dim=1152, img_size=224, tasks_per_batch =16, num_test_tasks=10000) and the same data loader. However, the 5-way 5-shot accuracy can only attain 94.8%, which is lower than your reported 96.1%. Are there any other tricks you used to improve the performance? Or I use the wrong hyper-parameters?

Jamine-W avatar Jun 07 '21 06:06 Jamine-W

I have the same problem with you, do u solve it ?

frelwx avatar Mar 07 '22 13:03 frelwx

I have the same problem with you, do u solve it ?

I've met the same troubles , and my machine can only support the options of resnet18 with img size 84x84 . On my machine, performance on ssv2(OTAM ) after traing 75000 tasks is 50.5+/-0.4 , perfomance on ucf101(ARN) after training 10000 tasks is 82.0+/-0.3. Have you solved this problem? QAQ

bedman367 avatar Mar 09 '22 11:03 bedman367

I have the same problem with you, do u solve it ?

I've met the same troubles , and my machine can only support the options of resnet18 with img size 84x84 . On my machine, performance on ssv2(OTAM ) after traing 75000 tasks is 50.5+/-0.4 , perfomance on ucf101(ARN) after training 10000 tasks is 82.0+/-0.3. Have you solved this problem? QAQ

I try the setting with res50 and 224x224, and achive the same accuracy as stated in this paper. I think you should just replace res18 or increase the img size.

frelwx avatar Apr 30 '22 05:04 frelwx

I use the code to train on hmdb51 with the suggested hyper-parameters and the same data loader. However, the 5-way 5-shot accuracy can only 74.3%, which is lower than the reported 75.6%. Besides,the accuracy on val set is much higher than in the test set,are you the same as me? And ,could you give me the correct video_reader document?I will be very grateful.([email protected])

xiaoc-git avatar May 16 '22 04:05 xiaoc-git

I have the same problem with you, do u solve it ?

I've met the same troubles , and my machine can only support the options of resnet18 with img size 84x84 . On my machine, performance on ssv2(OTAM ) after traing 75000 tasks is 50.5+/-0.4 , perfomance on ucf101(ARN) after training 10000 tasks is 82.0+/-0.3. Have you solved this problem? QAQ

I try the setting with res50 and 224x224, and achive the same accuracy as stated in this paper. I think you should just replace res18 or increase the img size.

佬 ,你处理数据集是根据作者另一个仓库中给到的代码来处理的吗

M77827 avatar Jul 05 '24 08:07 M77827