self-rag icon indicating copy to clipboard operation
self-rag copied to clipboard

Bug report & Self-RAG never predicts `[Retrieval]` when set `threshold=None`

Open ZhangzihanGit opened this issue 1 year ago • 0 comments

Hi @AkariAsai,

I noticed that you fixed the bug in this issue. However, there is no pred in the context, do you mean pred_text?

In addition, when I set threshold = None and let Self-RAG do the prediction of [Retrieval], it seems that the pred_text never contains the token, and therefore it does not retrieve at all on the PopQA dataset, i.e. the retrieval frequency = 0.

Is there something wrong?

Thank you!

ZhangzihanGit avatar Jan 30 '24 13:01 ZhangzihanGit