CvT icon indicating copy to clipboard operation
CvT copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

About Cls_cvt.py

Open diaodeyi opened this issue 3 years ago • 2 comments

I want to konw why there isn't any to the function get_cls_model and compute_macs

diaodeyi avatar Sep 20 '21 13:09 diaodeyi

By the way the self.proj = nn.Linear(dim_out, dim_out) Means FFN only projection with same dimension?

diaodeyi avatar Oct 03 '21 02:10 diaodeyi

By the way the self.proj = nn.Linear(dim_out, dim_out) Means FFN only projection with same dimension?

Yes, it is a part of the attention mechanism.

sauravgarg540 avatar Nov 05 '21 17:11 sauravgarg540