inseq icon indicating copy to clipboard operation
inseq copied to clipboard

[WIP] Fix batching in DIG

Open gsarti opened this issue 3 years ago • 1 comments

Description

Fixes #113

Type of Change

🔧 Bug fix (non-breaking change which fixes an issue)

gsarti avatar Dec 02 '21 10:12 gsarti

Current status:

  • DIG attribution was made compatible with newer changes (decoder-only model support, etc.) and supports both source and source-target attribution.
  • The problematic behavior of inconsistent outputs when testing the same input alone vs. inside a batch persist. The issue is probably in the scale_input function call inside DiscretizedIntegratedGradient.attribute, since the rest is mostly compatible with the original IG attribution.
  • Open question: is return_convergence_delta meaningful in this setting? First thoughts: it could provide information on the distance from a good non-orthogonal path, but should not be used as in IG.

gsarti avatar Nov 30 '22 13:11 gsarti