tensorrtllm_backend
tensorrtllm_backend copied to clipboard
Is ReDrafter supported by the TensorRT-LLM backend?
System Info
N/A
Who can help?
@byshiue
Information
- [X] The official example scripts
- [ ] My own modified scripts
Tasks
- [X] An officially supported task in the
examplesfolder (such as GLUE/SQuAD, ...) - [ ] My own task or dataset (give details below)
Reproduction
Is ReDrafter supported by the TensorRT-LLM backend for Triton?
Expected behavior
n/a
actual behavior
n/a
additional notes
n/a