bg51717

I want to use this project to evaluate my models.Howerer,when I use the command: ``` pip install promptbench ``` It raise a error as the title.The promptbench require the datasets==2.15.0,but...

Thank you for your work—it helps fill an important gap in multilingual model evaluation. I evaluated Qwen/Qwen2.5-3B using the following command: ``` lighteval accelerate\ --model_args "vllm,pretrained=Qwen/Qwen2.5-3B,pairwise_tokenization=True,dtype=bfloat16,gpu_memory_utilisation=0.8" \ --custom_task lighteval.tasks.multilingual.tasks \...

Hi, thanks for your great work on SVDLLM! I would like to ask if you have any plans to release the code for SVDLLM v2. The community is very interested,...