BiViT icon indicating copy to clipboard operation
BiViT copied to clipboard
verified publisher icon ThisisBillhe

Problems on reproducing the experimental results.

Open Alexrich961210 opened this issue 1 year ago • 4 comments

Could you please update some key codes or configs for helping reproducing the results of TinyImageNet in this paper? Thanks for your help.

Alexrich961210 avatar Jan 03 '24 15:01 Alexrich961210

any specific config or problem you have met?

ThisisBillhe avatar Jan 04 '24 02:01 ThisisBillhe

Thanks for your reply. I have these specific problems:

  1. Is the data augmentation totally same as the default settings in DeiT repository?
  2. Which teacher model is used for training the BiViT on TinyImageNet and ImageNet?

Alexrich961210 avatar Jan 04 '24 02:01 Alexrich961210

  1. yes.
  2. We use the corresponding FP model as the teacher model for BiViT.

ThisisBillhe avatar Jan 04 '24 05:01 ThisisBillhe

For Answer 2, does that mean we need to finetune a pretrained FP model on TinyImageNet first?

Alexrich961210 avatar Jan 04 '24 06:01 Alexrich961210