openvino icon indicating copy to clipboard operation
openvino copied to clipboard

[DOCS] Update NNCF weight compression LLM example

Open helena-intel opened this issue 1 year ago • 0 comments

  • Update example to not compile the full precision model and not compress the model to INT8 before compressing to INT4
  • Update installation command: nncf is now included in optimum[openvino]

We may also want to update the optimum example to use OVWeightQuantizationConfig.

@AlexKoff88

helena-intel avatar Jun 28 '24 19:06 helena-intel