Any plans to add AutoGPTQ as a gptq load option?

[fblissjr]

trafficstars

See: https://github.com/PanQiWei/AutoGPTQ/

For reference, text gen ui is using it here: https://github.com/oobabooga/text-generation-webui/blob/main/modules/AutoGPTQ_loader.py