Abhay Gupta

Results 3 comments of Abhay Gupta
trafficstars

Can you give a few more details as to where the bug is occurring?

Hi, I'm looking into this. Thanks for pointing it out -- it worked because of some hacks in my local system. Let me do the correct fix and point it...

another question on this - is the exact-match metric now defined in v0.4.2 the same as the maj@1 metric reported in the llama paper? Same for the GSM8K dataset.