nncf
nncf copied to clipboard
PTQ for the OpenVINO backend
Changes
- The
nncf.data.Dataset
class was added. Also, available asnncf.Dataset
. Please look at the documentation of this class to get more details. - Added support of PTQ for the
openvino.runtime.Model
via Post-training Optimization Tool API. The methodnncf.quantization.quantize()
was added. Also, available asnncf.quantize()
. This method applies post-training quantization to the provided model. - The
nncf.TargetDevice
enum was added. It uses to specify thetarget_device
parameter in thenncf.quantize()
method. - The
nncf.QuantizationPreset
enum was added. It uses to specify thepreset
parameter in thenncf.quantize()
method.
Public API:
-
nncf.Dataset
-
nncf.quantize()
-
nncf.TargetDevice
-
nncf.QuantizationPreset
Reason for changes
The NNCF should support the PTQ for the OV model.
Related tickets
Ref: 90642