SlimSAM icon indicating copy to clipboard operation
SlimSAM copied to clipboard

Published 20 hours ago • verified publisher icon czg1225

The MACs result doesn't contain q@k and attn@V

Open Yiman-GO opened this issue 9 months ago • 1 comments

The calculation workload of matrix multiplication in the attention modules(qk and attnV) which is nonnegligible, is not included in torch_pruning.utils.count_ops_and_params。 torchprofile can calculate the macs of q@k and k@v.

Yiman-GO avatar May 07 '24 08:05 Yiman-GO

Hi @Yiman-GO , Thanks for the issue. I will check it with the author of torch pruning.

czg1225 avatar May 08 '24 05:05 czg1225