Daniel Yu

What is the input shape of bertQKVToContextPlugin?

1

The comment at https://github.com/NVIDIA/TensorRT/blob/main/plugin/bertQKVToContextPlugin/qkvToContextPlugin.cpp#L155 says that the input shape is `[B, S, 3*N*H]` or `[B, S, 3*E]`; but the README.md file says the input shape is `[S, B, 3*E, 1,...

[QST] Does fp8 on Ada Lovelace require CUDA 12.4 (>=550) driver?

1

**What is your question?** The release notes for CUTLASS v3.5.0 states that fp8 for Ada Lovelace kernel requires CUDA 12.4 or higher. Is it a compile-time only requirement, or it...

The Chinese version shouldn't translate the English comment in the bad example of "Always write comments in your native language" into Chinese. If the comment got translated, it should be...