BSN-boundary-sensitive-network.pytorch icon indicating copy to clipboard operation
BSN-boundary-sensitive-network.pytorch copied to clipboard

Published 20 hours ago • verified publisher icon wzmsltw

Testing framework on THUMOS

Open tobiascz opened this issue 6 years ago • 10 comments

@cinjon how is your progress to try this code on THUMOS?

If I understand this correctly I have to extract the snippet level features using TSN (https://github.com/yjxiong/anet2016-cuhk). But the anet2016-cuhk is pretrained on activity net so you first have to finetune the network on THUMOS and then extract the snippet level features from THUMOS and do the TEM, PGM & finally the PEM training? Is this correct?

Originally posted by @tobiascz in https://github.com/wzmsltw/BSN-boundary-sensitive-network.pytorch/issues/12#issuecomment-534916470

tobiascz avatar Sep 25 '19 08:09 tobiascz

Sort of? I can get similar results to the original using the TF code that @wzmsltw sent (see below). However, trying to turn that into Pytorch has proven oddly difficult to match.

This is using the TF code: evaluation_result Area Under the AR vs AN curve: 56.48403108317774% Interpolation results: 50: 0.3059, 100: 0.4012, 200: 0.4855, 500: 0.5748, 1000: 0.6324

This is using the pytorch code translated to use Thumos: evaluation_result Area Under the AR vs AN curve: 52.81808977831542% Interpolation results: 50: 0.2841, 100: 0.3840, 200: 0.4721, 500: 0.5470, 1000: 0.5721

cinjon avatar Sep 27 '19 22:09 cinjon

Update: I now have this reproducing in pytorch as well.

cinjon avatar Sep 29 '19 22:09 cinjon

I'm also interesting in the thumos14, any update so far?

zaie avatar Nov 02 '19 01:11 zaie

Hi @cinjon, you seem to have succeeded in coding the thumos14 version. I'd like to do some statistics on the results. Is it possible for you provide me the .txt file having the results in? Thx

guillaumevr avatar Nov 08 '19 12:11 guillaumevr

Hi, i unfortunately don't have much time to help others atm because i'm trying to submit my own CVPR paper next week.

cinjon avatar Nov 08 '19 12:11 cinjon

Hi @cinjon , I'm trying to do some work on THUMOS14, can you share me the code in THUMOS14 version? Maybe just data preparation. THX.

WhiteDOU avatar Feb 15 '20 10:02 WhiteDOU

Hello, @tobiascz

Thanks for this good question. And I am also confused by applying BSN to a customized dataset. The biggest question of me is, which exact layer of the output of TSN should I keep, in order to train the BSN? Or, in other words, how do you prepare your data? If would be very nice if you may be able to share the preprocessing codes with me. Thank you in advance!

PF

Catosine avatar Mar 18 '20 06:03 Catosine

@cinjon can you share the PyTorch code for THUMOS 14 that you used to reproduce the results

Griffintaur avatar Mar 27 '21 20:03 Griffintaur

Hello, Can anyone please share the code and extracted features for THUMOS14 dataset? @cinjon My email: [email protected] I'd appreciate your help!

elahevahd avatar Dec 13 '21 17:12 elahevahd