Alexander Suslov

Results 24 issues of Alexander Suslov

### Changes - Added support for compression of f8e4m3 and f8e5m2 weights into 4-bit types. - Added skipping compression of f8e4m3 and f8e5m2 weights into 8-bit types. - Added support...

NNCF OpenVINO
NNCF PTQ

### Context A “stateful model” is a model that implicitly preserves data between two consecutive inference calls such as KV cache for LLMs ([more details](https://docs.openvino.ai/nightly/openvino-workflow/running-inference/inference-request/stateful-models.html#)). Using a stateful model in...

good first issue

### Changes ### Reason for changes ### Related tickets ### Tests

NNCF OpenVINO
NNCF PTQ

### Changes ### Reason for changes ### Related tickets ### Tests

NNCF PT