LongICLBench icon indicating copy to clipboard operation
LongICLBench copied to clipboard

Published 20 hours ago • verified publisher icon TIGER-AI-Lab

Unexpected low performance of mistral-v0.1

Open Mooler0410 opened this issue 2 months ago • 4 comments

Hi!

I tried to run BANKING77 with mistral-7b-v0.1. However, I got a nearly zero performance. I have no idea about how this could happen. Have you ever tested mistral-7b-v0.1? Or, if not, did you ever encounter similar issues?

Thanks!

Mooler0410 avatar Apr 19 '24 18:04 Mooler0410