taming-transformers icon indicating copy to clipboard operation
taming-transformers copied to clipboard

Published 20 hours ago • verified publisher icon CompVis

How to distinguish sos token(default = 0) and quantified image token zero ?

Open JJJYmmm opened this issue 11 months ago • 2 comments

Since the transformer take in the quantified image token generated by VQGAN, which codebook has indices (0~n_embed-1), and transformer’s sos token is also set to zero defaultly. Could you tell me why we don't distinguish codebook vector0 and the sos token when training transformer?

JJJYmmm avatar Mar 26 '24 12:03 JJJYmmm