candle icon indicating copy to clipboard operation
candle copied to clipboard

fix: missing shared tensor in bert::BertLMPredictionHead

Open silver-ymz opened this issue 7 months ago • 0 comments

(cls.predictions.decoder.weight, bert.embeddings.word_embeddings.weight) and (cls.predictions.decoder.bias, cls.predictions.bias) are shared tensor in BertForMaskedLM model. They may not exist in model.safetensors file.

silver-ymz avatar Apr 11 '25 12:04 silver-ymz