h2o-llmstudio icon indicating copy to clipboard operation
h2o-llmstudio copied to clipboard

Improve Model Card Template

Open psinger opened this issue 2 years ago • 0 comments

Here are a few things to improve in the model card:

  • Some models fail if input contains wrong keys, such as type ids. We should delete them after the tokenizer, or be specific of what we send to the generate, i.e. only send input ids and attention mask.
  • Remove model validation section
  • Potentially add quantization example everywhere

psinger avatar Jun 20 '23 07:06 psinger