bitsandbytes Add xpu support for 4bit (nf4/fp4) and 8bit quantization

Add xpu support for 4bit (nf4/fp4) and 8bit quantization

Open zhuhong61 opened this issue 1 year ago • 2 comments

trafficstars

Jun 25 '24 11:06 zhuhong61

@jiqing-feng Could you please help review? thanks!

Jun 25 '24 11:06 zhuhong61

@faaany, could you try it in XPU? Thx

Jun 26 '24 08:06 yao-matrix

@jiqing-feng @zhuhong61 Is this PR orphaned? In that case I would close it and you can resubmit whenever you're ready.

Mar 07 '25 16:03 Titus-von-Koeller

We can close it as XPU already implemented in BNB

Mar 10 '25 01:03 jiqing-feng