Indraneel comments

Repositories
Issues
Comments

Results 2 comments of


                                            Indraneel

Cannot build engine w. FP8 FMHA on 5090

I'm using an RTX 5090.

Cannot build engine w. FP8 FMHA on 5090

I get the same error. Here is the output of the engine build command. ``` root@174d3b87a87a:/code/tensorrt_llm/examples/llama# trtllm-build --checkpoint_dir ./mllama_checkpoint_fp8 --use_fused_mlp enable --gpt_attention_plugin auto --output_dir ./trt_engines_fp8b --max_batch_size 1 --max_seq_len 4096 --reduce_fusion...