PaddleOCR VL on macOS is trying to load bfloat16 weights into float32 tensors
🔎 Search before asking
- [x] I have searched the PaddleOCR Docs and found no similar bug report.
- [x] I have searched the PaddleOCR Issues and found no similar bug report.
- [x] I have searched the PaddleOCR Discussions and found no similar bug report.
🐛 Bug (问题描述)
The issue is that PaddleOCR VL on macOS is trying to load bfloat16 weights into float32 tensors. This is a known compatibility issue. The model files were trained in bfloat16 but macOS/Apple Silicon may not fully support it.
now there's a dtype mismatch issue. The model was saved in bfloat16 but PaddlePaddle is trying to load it as float32. This is a compatibility issue with macOS (Apple Silicon doesn't fully support bfloat16).
🏃♂️ Environment (运行环境)
macOS M4 Pro
🌰 Minimal Reproducible Example (最小可复现问题的Demo)
on MacOS, M chip, got error messsage when process "Error Variable dtype not match, Variable [ linear_164.w_0 ] need tensor with dtype paddle.float32 but load tensor with dtype paddle.bfloat16"
Hi, regarding compatibility with Apple Silicon, there are indeed some issues at the moment. We will address this in a future update.