Add multi-gpu support for `from_quantized` call

Open mobicham opened this issue 1 year ago • 0 comments

HQQ multi-gpu support is so far only supported for the quantize_model model call.

May 08 '24 09:05 mobicham