captum
captum copied to clipboard
No negative attributions when using IG with BERT embeddings and 1-layer RNN
I have a single layer RNN model that takes BERT token embeddings as input. When calculating attributions using Integrated Gradients, I don't seem to get any negative attributions at all. But with Occlusion I do get both positive and negative attributions for the same inputs. Any idea what could be causing this?