ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard
verified publisher icon intel-analytics

B60 Cannot Use FP16 Precision with MOE

Open RobinJing opened this issue 7 months ago • 1 comments

Describe the bug B60 Cannot Use FP16 Precision with MOE

How to reproduce Load Qwen3-30B-A3B with dtype float16 and lowbit fp16, the issue occurs.

Screenshots

Image

RobinJing avatar May 22 '25 07:05 RobinJing

B60? ？？ B580 24g？

wrteww avatar May 23 '25 00:05 wrteww