sherpa icon indicating copy to clipboard operation
sherpa copied to clipboard

Whisper model cannot build with tensorrt llm

Open billlyzhaoyh opened this issue 10 months ago • 2 comments

Been following the instruction at https://github.com/k2-fsa/sherpa/tree/master/triton/whisper and somehow running the line python3 build.py --output_dir whisper_large_v3 --use_gpt_attention_plugin --use_gemm_plugin --use_bert_attention_plugin --enable_context_fmha results in error:

TypeError: DecoderModel.__init__() missing 7 required positional arguments: 'num_heads', 'hidden_size', 'ffn_hidden_size', 'encoder_num_heads', 'encoder_hidden_size', 'vocab_size', and 'dtype'

billlyzhaoyh avatar Apr 27 '24 11:04 billlyzhaoyh