Can convert HRFormer backbone into TensorRT？

[ZhengMengbin]

Can convert HRFormer backbone into TensorRT? I want to speed it, but the structure is so complex, especially 'class MHA_(MultiheadAttention)', can you give some advice?

[PkuRainBow]

@ZhengMengbin Thanks for your interest in our work! Please feel free to email me to discuss the details of "class MHA_(MultiheadAttention)". In fact, our HRFormer architecture might be the simplest choice to combine "HRNet" and "Transformer".