Dan Saattrup Smart comments

Results 240 comments of


                                            Dan Saattrup Smart

[MODEL EVALUATION REQUEST] ibm-granite/granite-8b-code-base

Benchmarked on Danish.

[MODEL EVALUATION REQUEST] ibm-granite/granite-8b-code-base

Benchmarked on English now too!

[MODEL EVALUATION REQUEST] ibm-granite/granite-7b-instruct

Bug! Same bug as in https://github.com/ScandEval/ScandEval/issues/478.

[MODEL EVALUATION REQUEST] ibm-granite/granite-7b-instruct

Bug! Same bug as in https://github.com/ScandEval/ScandEval/issues/478.

[MODEL EVALUATION REQUEST] ibm-granite/granite-7b-instruct

Bug! #563

[MODEL EVALUATION REQUEST] ibm-granite/granite-7b-instruct

Results live now 🎉

[MODEL EVALUATION REQUEST] 01-ai/Yi-1.5-9B

Bug! #268

[MODEL EVALUATION REQUEST] 01-ai/Yi-1.5-9B

Live on the leaderboards now 🎉

[FEATURE REQUEST] Support llama.cpp backend

> It seems it varies a little how people publish the gguf's. NorwAI put them in the same repo, and one then has to download the file manually, or use...

[MODEL EVALUATION REQUEST] tiiuae/falcon-11B

Live on the leaderboards 🎉