Ziwang

After formula five, you said "we can obtain P groups of semantic-specific node embeddings" . I looked through the full paper and found no expression or formula for this semantic-specific...

Question about mask language modeling

1

Hello, I have a problem with the following lines about the mlm/span mask: https://github.com/pkusjh/LASS/blob/43f4c5e76525120ead3097fc3952f719db6dc695/model/data_collator.py#L24 https://github.com/pkusjh/LASS/blob/43f4c5e76525120ead3097fc3952f719db6dc695/model/roberta_model.py#L95 Are these lines not executed in the code? Operations related to mask language modeling are...