ScandEval icon indicating copy to clipboard operation
ScandEval copied to clipboard
verified publisher icon ScandEval

[MODEL EVALUATION REQUEST] ibm-granite/granite-3b-code-instruct

Open saattrupdan opened this issue 1 year ago • 1 comments

Model ID

ibm-granite/granite-3b-code-instruct

Model type

Decoder model (e.g., GPT)

Model languages

  • [X] Danish
  • [X] Swedish
  • [X] Norwegian (Bokmål or Nynorsk)
  • [X] Icelandic
  • [X] Faroese
  • [X] German
  • [X] Dutch
  • [X] English

Merged model

Not a merged model

saattrupdan avatar Jun 13 '24 19:06 saattrupdan

Bug! Same bug as in https://github.com/ScandEval/ScandEval/issues/478.

saattrupdan avatar Aug 07 '24 08:08 saattrupdan

Bug! #563

saattrupdan avatar Oct 28 '24 15:10 saattrupdan

Results live on the leaderboards now 🎉

saattrupdan avatar Oct 31 '24 15:10 saattrupdan