Yutao ZHU

icon indicating a website link https://daod.github.io

icon company Renmin University of China icon location Beijing, China icon location Postdoc @ GSAI, RUC

Results 2 issues of Yutao ZHU

Why no attention mask used?

1 comment

In vanilla BERT, we should input attention mask to avoid performing attention on padding positions. However, in this code repository, no attention mask is used. Is there any reason for...

Is it possible to also provide the checkpoint of the fine-tuned model?

Thanks for your contribution in sharing such an awesome work! It would be grateful if you can also share us with the fine-tuned checkpoint. Regards Z.