CLIP-Adapter icon indicating copy to clipboard operation
CLIP-Adapter copied to clipboard

questions about text adapter

Open zhangbw21 opened this issue 2 years ago • 1 comments

hello, you said in your paper that you use adapter in both visual and text stream, but in your code i just find the visual one, which one is correct? Thanks a lot.

zhangbw21 avatar Aug 10 '22 07:08 zhangbw21

I believe this is the first variant of CLIP-Adapter that they describe in Section 4.1.1 of the paper (Training Settings). The exact quote from the paper is: "The first variant of CLIP-Adapter is adopted by default if not specified, which fine-tunes the image feature while freezes the classifier weight. In other words, it only implements CLIP-Adapter for the visual adapter".

vishaal27 avatar Aug 16 '22 10:08 vishaal27