captum icon indicating copy to clipboard operation
captum copied to clipboard

lrp rules for matrix multiplication

Open oldcricket opened this issue 3 years ago • 0 comments

Is there a lrp rule implemented in captum for matrix multiplication, as suggested in this document (https://openaccess.thecvf.com/content/CVPR2021/supplemental/Chefer_Transformer_Interpretability_Beyond_CVPR_2021_supplemental.pdf)? It is shown in this document that matrix multiplication breaks the relevance conservation property, and some special normalization is needed to maintain such a property. Thanks in advance!

oldcricket avatar Feb 12 '22 15:02 oldcricket