Unable to run the finetuning sample with transformers==4.36.0 version.

[xiangyang-95]

Due to the requirements from mixtral that needs transformers==4.36.0, I tried to run the finetuning example but hit into error when I am trying this.

[xiangyang-95]

This is the error present: SafetensorError('device xpu is invalid')

[rnwang04]

Hi @xiangyang-95 , could you please share us your detailed code / error message and your pip list so that we maybe can reproduce your errors : )

[rnwang04]

By the way, based on my experience, if you want to finetune mixtral, it would be better to use transformers==4.36.1 to avoid error in saving checkpoint.

[xiangyang-95]

Able to finetune after upgrading to transformers==4.36.1