TensorRT-LLM
TensorRT-LLM copied to clipboard
Fix nmt weight conversion
For WMT14 model, it shares the vocab across the encoder and decoder. So it wouldn't trigger this error. However, for language pair which has large differences like zh-en, usually we don't share the vocab. So here we need set the vocab size for decoder correctly.