Abhay Gupta
Results
3
comments of
Abhay Gupta
trafficstars
Can you give a few more details as to where the bug is occurring?
Hi, I'm looking into this. Thanks for pointing it out -- it worked because of some hacks in my local system. Let me do the correct fix and point it...
another question on this - is the exact-match metric now defined in v0.4.2 the same as the maj@1 metric reported in the llama paper? Same for the GSM8K dataset.