LLaVA-UHD-Better icon indicating copy to clipboard operation
LLaVA-UHD-Better copied to clipboard

Published 20 hours ago • verified publisher icon ParadoxZW

Attention mask的计算？

Open hust-nj opened this issue 7 months ago • 15 comments

https://github.com/ParadoxZW/LLaVA-UHD-Better/blob/main/llava_uhd/adapt_llava.py#L136-L138

这里由于The first token is for CLS，是不是需要把

m[:w * h] = True

改成

m[:w * h+1] = True

hust-nj avatar Jun 30 '24 02:06 hust-nj