tensorrtllm_backend icon indicating copy to clipboard operation
tensorrtllm_backend copied to clipboard

Is ReDrafter supported by the TensorRT-LLM backend?

Open vkc1vk opened this issue 1 year ago • 2 comments

System Info

N/A

Who can help?

@byshiue

Information

  • [X] The official example scripts
  • [ ] My own modified scripts

Tasks

  • [X] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
  • [ ] My own task or dataset (give details below)

Reproduction

Is ReDrafter supported by the TensorRT-LLM backend for Triton?

Expected behavior

n/a

actual behavior

n/a

additional notes

n/a

vkc1vk avatar Oct 05 '24 00:10 vkc1vk