openvino icon indicating copy to clipboard operation
openvino copied to clipboard

Published 20 hours ago • verified publisher icon openvinotoolkit

[CPU] Shared compressed weights support

Open v-Golubev opened this issue 10 months ago • 1 comments

Details:

  • Shared decompression between 2 Matmuls is supported for 8bits and 4bits weights
  • Shared decompression between Matmul and Gather is supported for 8bits and 4bits weights
  • Added CPU subgraph test

Tickets:

  • CVS-140442 <= Validation results can be found there
  • CVS-137591
  • CVS-136594

v-Golubev avatar Apr 18 '24 11:04 v-Golubev

@usstq Please take a look

dmitry-gorokhov avatar Apr 24 '24 08:04 dmitry-gorokhov