TensorRT-LLM icon indicating copy to clipboard operation
TensorRT-LLM copied to clipboard

Can TensorRT-LLM supoort facebook/nllb-200-3.3B?

Open micronetboy opened this issue 1 year ago • 3 comments

System Info

Nvidia A100 PCIe 80G

Who can help?

none

Information

  • [X] The official example scripts
  • [X] My own modified scripts

Tasks

  • [X] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
  • [X] My own task or dataset (give details below)

Reproduction

Can TensorRT-LLM supoort facebook/nllb-200-3.3B?

Expected behavior

Can TensorRT-LLM supoort facebook/nllb-200-3.3B?

actual behavior

none

additional notes

none

micronetboy avatar Jan 25 '24 12:01 micronetboy

@ncomly-nvidia hey any update on this, i am looking forward to also port seamlessM4T_v2 models to tensorRT LLM. would be willing to write all the code and make the port, and submit a PR. need some direction and rough guidance.

StephennFernandes avatar Apr 27 '24 13:04 StephennFernandes