K-BERT icon indicating copy to clipboard operation
K-BERT copied to clipboard

Published 20 hours ago • verified publisher icon autoliuweijie

extend to other pre-trained LMs

Open lytum opened this issue 2 years ago • 1 comments

Hi,

thanks for sharing the excellent work. May I ask if this knowledge-graph based model can be extended into other pre-trained models, like RoBERTa or GPT2? My understanding is Yes. Could you give me more explanation about that? Thanks a lot!!

lytum avatar Jul 14 '21 08:07 lytum

Hi,

thanks for sharing the excellent work. May I ask if this knowledge-graph based model can be extended into other pre-trained models, like RoBERTa or GPT2? My understanding is Yes. Could you give me more explanation about that? Thanks a lot!!

Yes, the model structures of RobERTa and BERT are the same.

autoliuweijie avatar Aug 02 '21 02:08 autoliuweijie