openvino
openvino copied to clipboard
[DOCS] Update NNCF weight compression LLM example
- Update example to not compile the full precision model and not compress the model to INT8 before compressing to INT4
- Update installation command: nncf is now included in optimum[openvino]
We may also want to update the optimum example to use OVWeightQuantizationConfig.
@AlexKoff88