xl1990

Results 2 comments of xl1990

I used the same example code and got the same problem. When the model is trying to load the pretrained weights, I got the following warning `Some weights of LlamaForCausalLM...

This problem may be caused by tie_weights for embedding and lm_head. I guess MiniCPM is reusing embedding.weight for lm_head.weight, but LlamaForCausalLM do not automatically do that. The simplest way to...