DoLa
DoLa copied to clipboard
Potential bug in JSD implementation in DOLA and ReDeep
I think there is a problem with the implementation of the Jensen-Shannon divergence in DoLa and a new hallucination detection method ReDeep. Here I described the problem: https://github.com/Jeryi-Sun/ReDEeP-ICLR/issues/2https://github.com/Jeryi-Sun/ReDEeP-ICLR/issues/2
The code for JS divergence is very similar and I think the same issue is in DoLa and as a consequence in transformers.