lighteval icon indicating copy to clipboard operation
lighteval copied to clipboard

[FT] Adding diskcache

Open JoelNiklaus opened this issue 10 months ago • 0 comments

Issue encountered

Rerunning evaluations with LLM as judge metrics can be expensive and time-consuming.

Solution/Feature

Adding a diskcache to the JudgeLM class could solve this.

JoelNiklaus avatar Nov 29 '24 13:11 JoelNiklaus