Hieu Tran

I have the same issue. Have you resolved it? I think you can treat 0's index as PAD tag/or O tag. And then compute scores exclude PAD/O tag.

> @raywanb somethingworth looking into would be also the technique presented here, which might be superior in some regards: > > https://www.lesswrong.com/posts/jGuXSZgv6qfdhMCuJ/refusal-in-llms-is-mediated-by-a-single-direction > > It cames with a nice colab...