PVT icon indicating copy to clipboard operation
PVT copied to clipboard

Question about cls token

Open eremo2002 opened this issue 2 years ago • 1 comments

Hi author! thanks for your nice work.

I have a question about cls token in PVT.

In ViT and DeiT, cls token is appended at input embedding process. But PVT append cls token at input of last stage.

Why PVT doesn't append cls token at input embedding process?

Thanks.

eremo2002 avatar Sep 22 '22 13:09 eremo2002

Hi author! thanks for your nice work.

I have a question about cls token in PVT.

In ViT and DeiT, cls token is appended at input embedding process. But PVT append cls token at input of last stage.

Why PVT doesn't append cls token at input embedding process?

Thanks.

would u tell me placement where appended cls ?, i find here image

IwantNewway avatar May 26 '24 02:05 IwantNewway