Samip Dahal

@gsujankumar have you by any chance been able to quantize gpt-x models like gpt-2 or gpt-j?

thanks for replying back @yaozhewei. Do you think you could provide any estimation on when the ZeroQuant inference will be released? any rough estimation would help!

should work now.

hey guys, thanks for the interest in the extension but I had to stop the VM where I was hosting the code generation model because it was getting expensive. Sorry...