MaskGIT-pytorch icon indicating copy to clipboard operation
MaskGIT-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon dome272

fix masking formula bug and only calculate loss on masked tokens

Open EmaadKhwaja opened this issue 1 year ago • 0 comments

cosine schedule calculates the number of tokens which are UNMASKED

EmaadKhwaja avatar Sep 03 '23 15:09 EmaadKhwaja