hezhihao10
hezhihao10
将模型载入参数改为from_tf, teacher_model = TinyBertForSequenceClassification.from_pretrained(args.teacher_model, num_labels=num_labels, from_tf=True) 载入BERT中文模型chinese_L-12_H-768_A-12.zip时失败, 报错信息为: `Initialize PyTorch weight ['cls', 'predictions', 'transform', 'LayerNorm', 'beta'] Skipping cls/predictions/transform/LayerNorm/gamma Skipping cls/predictions/transform/LayerNorm/gamma Skipping cls/predictions/transform/LayerNorm/gamma Skipping cls/predictions/transform/LayerNorm/gamma Traceback (most recent call last): File...
I can not find the download button in this website(https://catalog.ldc.upenn.edu/LDC2013T19) even if I register an account.