sherpa
sherpa copied to clipboard
Whisper model cannot build with tensorrt llm
Been following the instruction at https://github.com/k2-fsa/sherpa/tree/master/triton/whisper
and somehow running the line python3 build.py --output_dir whisper_large_v3 --use_gpt_attention_plugin --use_gemm_plugin --use_bert_attention_plugin --enable_context_fmha
results in error:
TypeError: DecoderModel.__init__() missing 7 required positional arguments: 'num_heads', 'hidden_size', 'ffn_hidden_size', 'encoder_num_heads', 'encoder_hidden_size', 'vocab_size', and 'dtype'