self-debiasing icon indicating copy to clipboard operation
self-debiasing copied to clipboard

Add _apply_decay_mask_logits function to avoid numerical instability

Open boxin-wbx opened this issue 3 years ago • 1 comments

boxin-wbx avatar Aug 20 '21 16:08 boxin-wbx

Thanks for the comment.

I think we can keep both versions. If there is no numerical instability issue, we can of course use _apply_decay_mask. Also, if you have time, you can run both versions and have a comparison between these two implementations. I suppose these two versions should not differ much.

boxin-wbx avatar Sep 01 '21 09:09 boxin-wbx