Dan Saattrup Smart
Dan Saattrup Smart
@Mikeriess There are missing quite a few (language, task) combinations there: - Missing `knowledge` and `common-sense-reasoning` tasks for all languages. - There's only a summarization task for Danish. - Missing...
Live on the leaderboards now 🎉
Not included in vLLM yet: https://github.com/vllm-project/vllm/issues/10783
Luxembourgish linguistic capabilities LLM benchmark: https://llmluxapp-a7tpfn2c5tgk8pqzecquvh.streamlit.app/
@lothritz Thanks for the references. Are you able to send the sentiment analysis and NER datasets to my email [email protected]? And @plumaj, thanks for joining the discussion! As the author...
@plumaj Great to hear about the dataset releases! Looking forward to them. As for the summarisation dataset, an often used approach is to start with a news dataset and use...
Not supported in vLLM yet.
Not supported in vLLM yet.
Live on the leaderboards now, thanks to @MikeRiess 🎉
Reopening due to #752.