tensorrtllm_backend icon indicating copy to clipboard operation
tensorrtllm_backend copied to clipboard

Build triton_trt_llm image in debug mode

Open nzarif opened this issue 9 months ago • 0 comments

Hi,

I am following the this doc and used this command to build Triton image with trt_llm backend from source:

DOCKER_BUILDKIT=1 docker build -t triton_trt_llm -f dockerfile/Dockerfile.trt_llm_backend . I am intrested in building the tensorrtllm backend in debug mode so when launching Triton I can attach to the tensorrt_llm backend processes using gdb. In order to so I need to build tensorrt_llm backend from source in debug mode. I can not find any debug mode flags in the Dockerfile or the build scripts. Is there a way to build trtllm_backend in debug mode so when running gdb can attach to it?

nzarif avatar Feb 05 '25 05:02 nzarif