HDCharles

Yeah, I will get started on this

@wconstab for the quantization benchmarking I'm wondering what a desirable 'scope' would be. The most natural type of quantization to benchmark is QAT, which has both training and evaluation. Then...

Well here is an initial PR, https://github.com/pytorch/benchmark/pull/323 This one is doing C and A.

you should use the nightly version of torch or at least the recent 2.2 branch cut, its a newish op that was added for int4 support.

looks like @ftian1 @holly1238 @yqhu wrote/landed the tutorial, can one of you guys take a look at this? The pytorch quantization oncall is listed for this issue but the tutorial...