attention-viz icon indicating copy to clipboard operation
attention-viz copied to clipboard

Published 20 hours ago • verified publisher icon catherinesyeh

Visualize value vectors too?

Open catherinesyeh opened this issue 2 years ago • 1 comments

Could plot value vectors too for each attention head... would definitely add to computational load though.

catherinesyeh avatar Jan 16 '23 16:01 catherinesyeh

  • [x] Could try scaling attention weights by value norms too

catherinesyeh avatar Feb 27 '23 17:02 catherinesyeh