feat: Add pp support for hybrid attn/mamba model

[yuxianq]

[yuxianq]

/bot run --disable-fail-fast --add-multi-gpu-test

[tensorrt-cicd]

PR_Github #5461 [ run ] triggered by Bot

[tensorrt-cicd]

PR_Github #5461 [ run ] completed with state SUCCESS /LLM/main/L0_MergeRequest_PR pipeline #3984 completed with status: 'SUCCESS'

[vegaluisjose]

Thanks @yuxianq , this looks great.

It would be great, however, to see if quality changes with this feature. We have another PR #4147 with this test.

@suyoggupta

[suyoggupta]

could you please add a brief PR description?

[suyoggupta]

Added copilot to also review this PR

[yuxianq]

@vegaluisjose I have cherry-pick https://github.com/NVIDIA/TensorRT-LLM/pull/4147 to this PR and the new test can pass locally.

[yuxianq]

could you please add a brief PR description?

@suyoggupta Added.

[yuxianq]

/bot reuse-pipeline

[tensorrt-cicd]

PR_Github #5681 [ reuse-pipeline ] triggered by Bot

[tensorrt-cicd]

PR_Github #5681 [ reuse-pipeline ] completed with state SUCCESS Reusing PR_Github #5461 for commit ba33051