InfiniteBench

InfiniteBench copied to clipboard

Support LLaMA Model

2

Thanks for your great work! Could you kindly advise on how to support the models in the LLaMA series?

ydyhello

found some annotation errors in 'longbook_qa_chn'

1

ID 41，42 的内容是斗破苍穹的内容，但是context里面并没有 “ 萧峰”这个人物出现。 是entity的替换没有放到context里面还是问题本身写错了？

Zeyu1994

Hi authors, thank you for your excellent work on ∞BENCH — it's an impressive and much-needed benchmark for evaluating long-context capabilities of LLMs. While reading the paper and exploring the...

ZhuohanX

When we pip the latest transformers as the version of it is not clarified in the requirements.txt, and then run src/eval_yarn_mistral.py, the following issue will come up: > MistralForCausalLM has...

LI-SUJU