SEED icon indicating copy to clipboard operation
SEED copied to clipboard

Difference in 'blocks' and 'blocks_for_image'

Open zheedong opened this issue 11 months ago • 2 comments

Hi, in tokenizer training, you apply blocks for reconstruction causal embedding, and apply blocks_for_image (in 'blip2_qformer_codebook_all_image.py'). But you apply only blocks in get_codebook_indicies (in 'qformer_quantizer.py'). Why is it difference here?

zheedong avatar Mar 04 '24 04:03 zheedong