captum
captum copied to clipboard
lrp rules for matrix multiplication
Is there a lrp rule implemented in captum for matrix multiplication, as suggested in this document (https://openaccess.thecvf.com/content/CVPR2021/supplemental/Chefer_Transformer_Interpretability_Beyond_CVPR_2021_supplemental.pdf)? It is shown in this document that matrix multiplication breaks the relevance conservation property, and some special normalization is needed to maintain such a property. Thanks in advance!