TensorRT-LLM
TensorRT-LLM copied to clipboard
Can TensorRT-LLM supoort facebook/nllb-200-3.3B?
System Info
Nvidia A100 PCIe 80G
Who can help?
none
Information
- [X] The official example scripts
- [X] My own modified scripts
Tasks
- [X] An officially supported task in the
examplesfolder (such as GLUE/SQuAD, ...) - [X] My own task or dataset (give details below)
Reproduction
Can TensorRT-LLM supoort facebook/nllb-200-3.3B?
Expected behavior
Can TensorRT-LLM supoort facebook/nllb-200-3.3B?
actual behavior
none
additional notes
none
@ncomly-nvidia hey any update on this, i am looking forward to also port seamlessM4T_v2 models to tensorRT LLM. would be willing to write all the code and make the port, and submit a PR. need some direction and rough guidance.