Could not find the transformer layer class to wrap in the model.

[Jerry-hyl]

When I use training code to finetune mistral-7b,I have met the exception like "Could not find the transformer layer class to wrap in the model.". How can I fix it?

[juliaparedesq]

Hi Jerry, Did you find a solution for this? I have the same exception

[Jerry-hyl]

@juliaparedesq I tried to remove --fsdp_transformer_layer_cls_to_wrap 'LlamaDecoderLayer' and the exception was gone. But after finetuning, the model's ability declined significantly. It seems that fastchat can only be used to deploy mistral model instead of finetuning it.