TensorRT-LLM icon indicating copy to clipboard operation
TensorRT-LLM copied to clipboard

Straightforward way to cancel `GenerationSession`

Open daniel-wispr opened this issue 1 year ago • 1 comments

Hi! I'm wondering if there's a straightforward way to kill/clean an in-progress decoding from a GenerationSession? My use case is running VAD + Whisper in parallel and early-stopping the decoding if VAD marks the chunk as silent.

daniel-wispr avatar Jun 20 '24 20:06 daniel-wispr

@daniel-wispr Not about your issue, but why don't you first do VAD then do ASR, which is more efficent.

yuekaizhang avatar Jul 11 '24 05:07 yuekaizhang

Hello @daniel-wispr ! Is this issue still relevant?

poweiw avatar Jul 29 '25 21:07 poweiw

Issue has not received an update in over 14 days. Adding stale label.

github-actions[bot] avatar Oct 07 '25 03:10 github-actions[bot]

This issue was closed because it has been 14 days without activity since it has been marked as stale.

github-actions[bot] avatar Oct 21 '25 03:10 github-actions[bot]