jw8023wh

> We followed Hugginface‘s pre-training scripts, you can replace the origin BertModel with our GlyceBertModel easily: here is the link: https://github.com/huggingface/transformers/tree/master/examples/pytorch/language-modeling 尝试了好久，并不easily呀 求开源pre-train的代码

> 请问是否有开源预训练的代码呢 请问，您是否有跑通Pre-train的过程呢？ 我在尝试利用自己的数据去做Pre-train, 踩坑好久