ao icon indicating copy to clipboard operation
ao copied to clipboard

int4_weight_only dequant does not restore original shape

Open jerryzh168 opened this issue 5 months ago • 0 comments

att, I think it's because we did padding before: https://github.com/pytorch/ao/blob/e1039abac7f429a8d7f489d047d9b34d6ac6afe2/torchao/dtypes/affine_quantized_tensor.py#L480 and we should restore the shape after unpacking from TensorCoreTiledLayout

jerryzh168 avatar Sep 09 '24 17:09 jerryzh168