AutoAWQ icon indicating copy to clipboard operation
AutoAWQ copied to clipboard

Published 20 hours ago • verified publisher icon casper-hansen

Support Volta architecture

Open sunyt32 opened this issue 2 years ago • 5 comments

Hi, do you have any plan that AutoAWQ will support V100 GPU in the future? I can run Auto-GPTQ on V100, but GPTQ's performance is worse than AWQ.

sunyt32 avatar Oct 13 '23 02:10 sunyt32

I am open to PRs that add support. If someone could contribute, it would be awesome

casper-hansen avatar Oct 13 '23 06:10 casper-hansen

I have a Dell C4140 server with 4x Tesla V100 SXM2 32GB NVLink GPUS and would love to see this setup supported in future!

barrymac avatar Nov 19 '23 19:11 barrymac

Hi, this is maked? regards

jesulo avatar Jan 04 '24 18:01 jesulo

No, this is not supported yet.

casper-hansen avatar Jan 04 '24 18:01 casper-hansen