PRP icon indicating copy to clipboard operation
PRP copied to clipboard

decoder structure of C3D, R3D, R21D

Open hw-liang opened this issue 5 years ago • 3 comments

Based on your repo, it seems that you are using the same decoder structure for all of the backbones(c3d, r3d, r(2+1)d). But in your paper, it seems you used different decoder structure based on C3D-block, R2D-block and R21D-block.

We cannot reproduce the result reported in the paper base on current code. Could you also provide your decoder implementation of r3d, r(2+1)d?

hw-liang avatar Feb 12 '21 17:02 hw-liang

In network architecture, they have mentioned that their decoder is the same.

" In video generation, four deconvolutional layers are stacked and followed by C3D blocks. To generate a video which is r times as slow as the input video, we set the 4-th deconvolutional layer with a stride of r × 2 × 2, where the reconstructing rate r is determined through ablation study."

I haven't tried to reproduce the exact results, but just to clear your doubt. Maybe the original authors could shed more light on how to reproduce the exact results.

AKASH2907 avatar Feb 12 '21 18:02 AKASH2907

In network architecture, they have mentioned that their decoder is the same.

" In video generation, four deconvolutional layers are stacked and followed by C3D blocks. To generate a video which is r times as slow as the input video, we set the 4-th deconvolutional layer with a stride of r × 2 × 2, where the reconstructing rate r is determined through ablation study."

I haven't tried to reproduce the exact results, but just to clear your doubt. Maybe the original authors could shed more light on how to reproduce the exact results.

Oh, I missed this part. Thank you very much! They provided the pretrained checkpoint and I try to reproduce UCF classification result with C3D model using the original code and hyper-setting, but there is 5% gap.

hw-liang avatar Feb 12 '21 18:02 hw-liang

The decoder structure of C3D, R3D, R21D is same.

yuanyao366 avatar Feb 13 '21 09:02 yuanyao366