DoLa icon indicating copy to clipboard operation
DoLa copied to clipboard

Potential bug in JSD implementation in DOLA and ReDeep

Open MichalBrzozowski91 opened this issue 9 months ago • 0 comments

I think there is a problem with the implementation of the Jensen-Shannon divergence in DoLa and a new hallucination detection method ReDeep. Here I described the problem: https://github.com/Jeryi-Sun/ReDEeP-ICLR/issues/2https://github.com/Jeryi-Sun/ReDEeP-ICLR/issues/2

The code for JS divergence is very similar and I think the same issue is in DoLa and as a consequence in transformers.

MichalBrzozowski91 avatar Mar 18 '25 14:03 MichalBrzozowski91