brevitas
brevitas copied to clipboard

Published 20 hours ago •

Reame
Issues

Feat: Support for Groupwise (MX) quantization

Open Giuseppe5 opened this issue 3 weeks ago • 0 comments

This implements:

New GroupwiseQuantTensor for Int and Float
Relevant Proxy classes
MX Float based quantizers
One notebook to test instantiation and execution

Missing:

Export
Default MXInt quantizers?

Jun 17 '24 10:06 Giuseppe5