Mingda Chen

icon indicating a website link mingdachen.github.io

icon company Fundamental AI Research at Meta icon location New York City

Results 2 comments of Mingda Chen

Clarification between your codes and the paper on NSP

Hi, thanks for your interest. The NSP implementation is in this line: https://github.com/ZeweiChu/DiscoEval/blob/master/train/models.py#L213 where we take the encoded vector "sent_vec" and reconstruct two neighboring sentences "tgt" and "tgt2". Regarding training...

Clarification between your codes and the paper on NSP

Right, that's my speculation.