Where to see the CUDA source code of these CUDA kernels?

[haitong]

Hi team,

I am interested to see the CUDA source code of these transformer kernels, like: https://github.com/NVIDIA/TensorRT/blob/e5f9ead4a4826cc774325720a26dbf4ec47203ea/plugin/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_128_64_kernel.sm75.cpp

Anyone know where to see the source code?

[zerollzeng]

@ttyio ^^ Are they open-source?

[ttyio]

@haitong , The fused kernels are not open sourced since it has internal tool chain dependency, we just encode the raw cubin in the github. Only the unfused implementation are available in github. Thanks!

[ttyio]

Closing since no activity for more than 3 weeks, please reopen if you still have question, thanks!