Can't get the answer using BM25Retriever

[giangpol]

Hello , We have used your cdQA to test sample dataset. But then it gets the wrong answer.

Do you have any idea on what the problem could be ?? Thank you Best Regards,

[ridhimagarg]

Hi @giangpol , I was also testing it out and feels like there is some issue in this retriever code.

I have gone through that and try changing it a little bit then comes up with another issue.

Pls if anyone could help us on the same will be good.

[RohitRanga12]

I created the dataframe with my custom dataset. The shape of my df is (40144, 2). When I call fit_retriever(), I get a memory error. But when I reduce the number of rows in the df to 2000, it works fine. Can you please look into this issue?