ml-fastvit
ml-fastvit copied to clipboard
apple
This repository contains the official implementation of the research paper, "FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterization" ICCV 2023
The last out indice should be 7 instead of 6, at least for the SA12 architecture. On SA12 if we return index 6 as the final layer it skips the...
[FastViT paper](https://arxiv.org/pdf/2303.14189.pdf) has the **BN -> Conv** order in the Repmixer block. But in this repo, it is in the **reverse order.** Included a flag 'use_bn_conv' to achieve this order,...
activation in `ReparamLargeKernelConv` is actually not used, and the code there is confusing. Please help make sure if this is intend to be, or a bug.
