tinyvision
Question regarding flops calculation
Dear authors, @xiuyu-sxy
I would like to verify the performance measures you have provided in your work, and particularly flops calculation.
Could you please let me know how one can reproduce flops numbers from the table in the Readme?
Thank you
You can use the get_complexity function in Vision_TransformerSuper to obtain the flops numbers.
You can use the get_complexity function in Vision_TransformerSuper to obtain the flops numbers.
Sure, but I don't understand what the sequence_length should be to get the numbers you have. It is inconsistent for three supernets: tiny, small and base.
Could you be so kind as to provide the value for the sequence_length parameter or values if those are different for the three supernets?
The image size is 224x224 in ImageNet. The patch size in ViT is 16x16. So I think the sequence_length is 14x14 for three supernets.