[Usage] how to use the checkpoints saved in the finutuning process to inference?

[hualala00]

Describe the issue

when i finetune the model on my custom dataset,i want to use the checkpoints saved in the finutuning process to inference to check model effect,and how to inference with the checkponits? If i only use the checkpoints to inference,there is a error as flowed： Do i need to merge the weight or something else?

[LeoLee7]

#245 looks relevant to your question