usajid14

@PerkzZheng Thank you for your insights. Can you please share some open-source link for benchmarking results that you mentioned above? Also, when I compare TRT-LLM FMHA kernel (fmha_v2_flash_attention_fp16_64_64_S_qkv_256_causal_tma_ws_sm90_kernel) for input=16384,...