Alexander Dokuchaev

Hi @abuvaneswari Thanks for raising this issue with detailed description and code to reproduce. Yes, there is problem with working on yolov5. We will soon fix this one.

torch_weekly/31 - failed

Hi @AdiKsOnDev Add `_validate` function to LMWeightCompression, that will contain call of evaluator from whowhatbench. Example of _validate function https://github.com/openvinotoolkit/nncf/blob/develop/tests/post_training/pipelines/image_classification_timm.py#L127 Metrics should be stored in `self.run_info` https://github.com/openvinotoolkit/nncf/blob/0b407de48da8d6e30fdb11325e8a1913139d5cfb/tests/post_training/pipelines/image_classification_timm.py#L170-L171

nightly/job/tf_nightly/63/ - TF nightly scope

Example of tables: https://github.com/openvinotoolkit/nncf/tree/develop/examples/quantization_aware_training/torch/resnet18 ``` +------------------+----------+-----------+-------------------------------+ | | FP32 | INT8 | Summary | +==================+==========+===========+===============================+ | Accuracy@1 | 55.520 | 56.715 | 55.360 (init) + 1.355 (tuned) | +------------------+----------+-----------+-------------------------------+ |...

@alexsu52 TriggerBetta/647

ci-maintenance/job/cuda-12.1.0/job/NNCF/job/nightly/job/TriggerBetta/8/ ci-maintenance/job/cuda-12.1.0/job/NNCF/job/nightly/job/torch_nightly/4/ ci-maintenance/job/cuda-12.1.0/job/NNCF/job/precommit/job/ubuntu20_precommit_pytorch/35/parameters/

manual/job/post_training_quantization/345 - with replace_timm_custom_modules_with_torch_native manual/job/post_training_quantization/344/artifact/results.html - w/o replace_timm_custom_modules_with_torch_native nightly/job/TriggerBetta/656 - (1 model failed by not related issue)

manual/job/post_training_quantization/351/

@alexsu52 QAT - resnet18 | develop | PR | PR/dev -- | -- | -- | -- total | 0:05:32 | 0:05:46 | 1.04 fine tune | 0:04:23 | 0:04:35...