train my own data, answers are not very accurate.

[yfq512]

I collect some chinese data about "中国云南" like this: And train follow the readme base on Baize-7B, cost 48 hours, get checkpoints finally. when I use this checkpoints to run app.py. The AI can speak Chinese, but sometimes it mixes English and Russian, and the answers are not very accurate.

Can you help me analyze the cause? Is it a lack of training data? Or the base model is an English model? Or something else? thanks

[JetRunner]

Are you using LLaMA as the foundation model? If so, as LLaMA has no Chinese pretraining data, it's not very surprising that the outcome isn't very good. BLOOMZ may be a better foundation model.