TensorRT-LLM fix：fix illeagel memory access when mtp >= 2

fix illeagel memory access caused by mtp eagle mode

Mar 24 '25 05:03 dongjiyingdjy

/bot run

Mar 24 '25 05:03 dongjiyingdjy

PR_Github #245 [ run ] triggered by Bot

Mar 24 '25 05:03 niukuo

PR_Github #245 [ run ] completed with state SUCCESS /LLM/main/L0_MergeRequest_PR pipeline #242 completed with status: 'FAILURE'

Mar 24 '25 08:03 niukuo

/bot run

Mar 24 '25 08:03 dongjiyingdjy

PR_Github #264 [ run ] triggered by Bot

Mar 24 '25 08:03 niukuo

PR_Github #264 [ run ] completed with state FAILURE /LLM/main/L0_MergeRequest_PR pipeline #254 completed with status: 'FAILURE'

Mar 24 '25 09:03 niukuo

Plz also open the hopper MTP tests, thx~

Mar 25 '25 02:03 lfr-0531

/bot run

Mar 25 '25 08:03 dongjiyingdjy

PR_Github #399 [ run ] triggered by Bot

Mar 25 '25 08:03 niukuo

PR_Github #399 [ run ] completed with state SUCCESS /LLM/main/L0_MergeRequest_PR pipeline #353 completed with status: 'SUCCESS'

Mar 25 '25 10:03 niukuo

/bot run

Mar 26 '25 13:03 dongjiyingdjy

/bot run

Mar 26 '25 13:03 dongjiyingdjy

Hi @dongjiyingdjy I think the issue also exists when MTP =2, can we change the title to make it more clear? Thanks :)

Mar 26 '25 16:03 jiahanc

/bot run

Mar 27 '25 02:03 dongjiyingdjy

PR_Github #631 [ run ] triggered by Bot

Mar 27 '25 03:03 tensorrt-cicd

PR_Github #631 [ run ] completed with state SUCCESS /LLM/main/L0_MergeRequest_PR pipeline #530 completed with status: 'SUCCESS'

Mar 27 '25 05:03 tensorrt-cicd

/bot run

Mar 31 '25 10:03 dongjiyingdjy

PR_Github #773 [ run ] triggered by Bot

Mar 31 '25 10:03 tensorrt-cicd

/bot run

Mar 31 '25 11:03 dongjiyingdjy

PR_Github #775 [ run ] triggered by Bot

Mar 31 '25 11:03 tensorrt-cicd

PR_Github #773 [ run ] completed with state ABORTED

Mar 31 '25 11:03 tensorrt-cicd

/bot run

Mar 31 '25 13:03 dongjiyingdjy

PR_Github #775 [ run ] completed with state FAILURE /LLM/main/L0_MergeRequest_PR pipeline #633 completed with status: 'FAILURE'

Mar 31 '25 14:03 tensorrt-cicd

/bot run

Mar 31 '25 14:03 dongjiyingdjy

/bot run

Apr 01 '25 01:04 dongjiyingdjy

PR_Github #820 [ run ] triggered by Bot

Apr 01 '25 02:04 tensorrt-cicd

PR_Github #820 [ run ] completed with state SUCCESS /LLM/main/L0_MergeRequest_PR pipeline #664 completed with status: 'SUCCESS'

Apr 01 '25 03:04 tensorrt-cicd

/bot reuse-pipeline

Apr 01 '25 04:04 lfr-0531

PR_Github #844 [ reuse-pipeline ] triggered by Bot

Apr 01 '25 04:04 tensorrt-cicd

PR_Github #844 [ reuse-pipeline ] completed with state SUCCESS Reusing PR_Github #820 for commit aed6d57

Apr 01 '25 04:04 tensorrt-cicd