FlexGen icon indicating copy to clipboard operation
FlexGen copied to clipboard

Add support for symmetric quantization

Open julian-q opened this issue 1 year ago • 0 comments

This PR adds support for symmetric quantization when compressing/decompressing tensors. This is useful for comparing the performance of both symmetric and asymmetric quantization.

  • supports storing compressed tensors without zero point
  • adds some bitwise operations to support signed quantized values

julian-q avatar Sep 16 '23 07:09 julian-q