graphtrans icon indicating copy to clipboard operation
graphtrans copied to clipboard

Another Bug report on MaskedOnlyTransformerEncoder

Open JizeZhangCS opened this issue 1 year ago • 0 comments

masked_transformer_encoder.py, line47, should be changed to

att = att.masked_fill(valid_input_mask.unsqueeze(1).unsqueeze(2) != 0, mask_value)

the origin code means that change all the place where valid_input_mask==False into mask_value

JizeZhangCS avatar Mar 16 '23 08:03 JizeZhangCS