ragas icon indicating copy to clipboard operation
ragas copied to clipboard

How to save intermediate evaluation results?

Open aligeniewcp22 opened this issue 1 year ago • 2 comments

When I evaluated the last piece of data (Evaluating 99%), the program got stuck. I had to run the entire evaluation process from scratch. Can I cache the intermediate results locally, and then continue with the previous results when I evaluate again?

aligeniewcp22 avatar Mar 08 '24 09:03 aligeniewcp22

That's interesting @aligeniewcp22 unfortunately we don't have that feature right now.

shahules786 avatar Mar 08 '24 23:03 shahules786

I have the same problem. Evaluation is stuck at the very last step. Does happen to me quite frequently, indepentently of the total step of evaluations and/or metric used.

Niggl0n avatar Apr 02 '24 10:04 Niggl0n