model-optimization icon indicating copy to clipboard operation
model-optimization copied to clipboard

Add batch norm to default_n_bit_quantize_registry and default_8_bit_quantize_registry

Open DerryFitz opened this issue 1 year ago • 2 comments

  • TensorFlow version (you are using): 2.13

Motivation There are many models which use batch norm in places where it is not covered by the existing cases allowed in the registry. Adding batch norm to the registry would allow users to apply QAT to such models.

At present I am editing both registries by adding the line

_QuantizeInfo(layers.BatchNormalization, ['gamma'], [], True),

which works for my case, but it would be nice to have a more general fix

DerryFitz avatar Sep 28 '23 10:09 DerryFitz

@Xhark Could you take a look at this issue? Thank you! :)

doyeonkim0 avatar Oct 04 '23 04:10 doyeonkim0

Any update on this?

DerryFitz avatar Jan 09 '24 00:01 DerryFitz