tensorrtllm_backend
tensorrtllm_backend copied to clipboard
Is `no_repeat_ngram_size` generation option supported?
System Info
N/A
Who can help?
@byshiue
Information
- [X] The official example scripts
- [ ] My own modified scripts
Tasks
- [X] An officially supported task in the
examplesfolder (such as GLUE/SQuAD, ...) - [ ] My own task or dataset (give details below)
Reproduction
n/a
Expected behavior
n/a
actual behavior
n/a
additional notes
n/a