temporal-shift-module icon indicating copy to clipboard operation
temporal-shift-module copied to clipboard

about file 'mobilenetv2_jester_online.pth.tar'

Open tjinjin95 opened this issue 3 years ago • 5 comments

Hi, thank you for providing the code, I have some questions about file 'mobilenetv2_jester_online.pth.tar'

  1. how to train 'mobilenetv2_jester_online.pth.tar'? Is its training process related to TSM?
  2. how to train a online model? (deal with buffer)

tjinjin95 avatar May 07 '21 03:05 tjinjin95

@tjinjin95 I trained online model using the TSM code. Then I save the model and inference using the inference code. Where you need to change is the buffer size ,you need make the buffer size compatible to your input . I do this,The output seems to be right.

chongyangwang-song avatar May 11 '21 06:05 chongyangwang-song

@tjinjin95 I trained online model using the TSM code. Then I save the model and inference using the inference code. Where you need to change is the buffer size ,you need make the buffer size compatible to your input . I do this,The output seems to be right.

hello there! may i know:

did you use the Jester dataset , and did you change the bi-direction to uni-direction shift in training? appreciate!

NB-Xie avatar Jul 06 '21 08:07 NB-Xie

@chongyangwang-song Cools. Looks like you have implemented the training code the right way. Could you kindly share the training code for jester dataset to me: [email protected], thank you .

dragen1860 avatar Jul 19 '21 03:07 dragen1860

我自己做的数据集,在自己数据集上跑的

---Original--- From: "Jackie @.> Date: Mon, Jul 19, 2021 11:44 AM To: @.>; Cc: @.@.>; Subject: Re: [mit-han-lab/temporal-shift-module] about file 'mobilenetv2_jester_online.pth.tar' (#187)

@chongyangwang-song Cools. Looks like you have implemented the training code the right way. Could you kindly share the training code for jester dataset to me: @.***, thank you .

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.

chongyangwang-song avatar Jul 19 '21 09:07 chongyangwang-song

@tjinjin95 I trained online model using the TSM code. Then I save the model and inference using the inference code. Where you need to change is the buffer size ,you need make the buffer size compatible to your input . I do this,The output seems to be right.

Hi, I also try to train the online model using the offline code, but the results are not good that the camera can't recognize hand gesture correctly. Then I try to evaluate the 'mobilenetv2_jester_online.pth.tar' parameters using the offline code, the results are not good either, the beat_prec1 is only around 5%. Thus I guess that the online code may need another special code for training.

And it seems that you have implemented the training code the right way, could you please provide some details about the training ? Or are there any problems with my policy? Thank you!

sean-001 avatar Sep 07 '21 14:09 sean-001