model-optimization icon indicating copy to clipboard operation
model-optimization copied to clipboard

block_size for pruning 3D weights

Open eejlny opened this issue 4 years ago • 1 comments

System information Ubuntu 18.02

  • TensorFlow version (you are using): 2.4.1
  • Are you willing to contribute it (Yes/No): Yes This relates to the pruning optimization

"block_size: The dimensions (height, weight) for the block sparse pattern in rank-2 weight tensors."

Currently it seems that the block_size feature during pruning only works for 2D weights and this seems to limit the application to dense layers. Would it be possible to block the 3D weights typically used by conv layers ? Not sure if there is any fundamental technical reason that prohibits this to work ? Since most layers are of the conv type it would speed up execution if the blocks could be used with 3D weights.

Thanks.

eejlny avatar Feb 22 '21 09:02 eejlny

Are there any updates in this? I would also like to use block_size with more dimensiones for CONV2d layers

fPecc avatar Jun 28 '22 14:06 fPecc