LongICLBench
LongICLBench copied to clipboard
Published
20 hours ago •
TIGER-AI-Lab
TIGER-AI-Lab
Code and Data for "Long-context LLMs Struggle with Long In-context Learning"
Results
2
LongICLBench issues
Sort by
recently updated
recently updated
newest added
Hi~ Thanks for sharing the evaluation code! I would like to ask where did Qwen1.5 add ntk-interpolation? I traced the code with Qwen2 with [huggingface transformers](https://huggingface.co/docs/transformers/model_doc/qwen2), and found they remove...
Hi! I tried to run BANKING77 with mistral-7b-v0.1. However, I got a nearly zero performance. I have no idea about how this could happen. Have you ever tested mistral-7b-v0.1? Or,...
Metadata
63
Stars
2
Forks
Watchers
Owner
Metadata
Code and Data for "Long-context LLMs Struggle with Long In-context Learning"