tch-rs icon indicating copy to clipboard operation
tch-rs copied to clipboard

Support of X86 quantization engine as in pytorch?

Open yanghou2000 opened this issue 6 months ago • 0 comments

According to this pytorch quantization guide, pytorch now supports a faster backend for int8 called X86 as a replace for FBGEMM. I find that in the tch-rs jit-quantized example tch-rs only supports either FBGEMM or QNNPACK.

I wonder if X86 will be supported soon, or is there a workaround so that tchrs can use X86 backend?

yanghou2000 avatar Aug 05 '24 14:08 yanghou2000