azmle112
azmle112
please! I have emailed two authors about this question， but no one reply me.
+1
> Probably will be fixed by [#38510](https://github.com/huggingface/transformers/pull/38510), there is a dtype mismatch due to keeping some modules in fp32可能会由 [#38510](https://github.com/huggingface/transformers/pull/38510) 修复，由于在 fp32 中保留某些模块，因此存在 dtype 不匹配 Hi, I applied the fix...
> Which version you have [@azmle112](https://github.com/azmle112) ? Can you try to install from `main` so all the fixes are pulled, it worked for me in the `main` with above script...