AutoAWQ icon indicating copy to clipboard operation
AutoAWQ copied to clipboard
verified publisher icon casper-hansen

I encountered the following problem during the KL assessment

Open xieziyi881 opened this issue 1 year ago • 2 comments

ValueError: You are attempting to load an AWQ model with a device_map that contains a CPU or disk device. This is not supported. Please remove the CPU or disk device from the device_map. image

xieziyi881 avatar Jun 28 '24 06:06 xieziyi881

I have the same issue. Did you figure that out?

Junsong798 avatar Sep 01 '24 20:09 Junsong798

Same error for me.

carinae avatar Sep 19 '24 15:09 carinae