h2o-llmstudio
h2o-llmstudio copied to clipboard
Improve Model Card Template
Here are a few things to improve in the model card:
- Some models fail if input contains wrong keys, such as type ids. We should delete them after the tokenizer, or be specific of what we send to the
generate, i.e. only send input ids and attention mask. - Remove model validation section
- Potentially add quantization example everywhere