tensorrtllm_backend icon indicating copy to clipboard operation
tensorrtllm_backend copied to clipboard

Is `no_repeat_ngram_size` generation option supported?

Open ghost opened this issue 1 year ago • 0 comments

System Info

N/A

Who can help?

@byshiue

Information

  • [X] The official example scripts
  • [ ] My own modified scripts

Tasks

  • [X] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
  • [ ] My own task or dataset (give details below)

Reproduction

n/a

Expected behavior

n/a

actual behavior

n/a

additional notes

n/a

ghost avatar Sep 03 '24 22:09 ghost