captum icon indicating copy to clipboard operation
captum copied to clipboard

No negative attributions when using IG with BERT embeddings and 1-layer RNN

Open itsmemala opened this issue 2 years ago • 0 comments

I have a single layer RNN model that takes BERT token embeddings as input. When calculating attributions using Integrated Gradients, I don't seem to get any negative attributions at all. But with Occlusion I do get both positive and negative attributions for the same inputs. Any idea what could be causing this?

itsmemala avatar Nov 16 '22 19:11 itsmemala