AutoGPTQ icon indicating copy to clipboard operation
AutoGPTQ copied to clipboard

Published 20 hours ago • verified publisher icon AutoGPTQ

Does AutoGPTQ currently support Ascend NPUs？

Open Dbassqwer opened this issue 1 year ago • 2 comments

Ascend NPUs are Huawei's neural network chips. Does AutoGPTQ currently support inference/training on Ascend NPUs?

Dbassqwer avatar Dec 22 '23 04:12 Dbassqwer

Hi @Dbassqwer, I don't think it does.

fxmarty avatar Jan 05 '24 11:01 fxmarty

Ascend NPUs are Huawei's neural network chips. Does AutoGPTQ currently support inference/training on Ascend NPUs?

Do you have any other solutions on Ascend NPU？

QDPeng avatar Aug 07 '24 09:08 QDPeng