tensorrtllm_backend
tensorrtllm_backend copied to clipboard
Build triton_trt_llm image in debug mode
Hi,
I am following the this doc and used this command to build Triton image with trt_llm backend from source:
DOCKER_BUILDKIT=1 docker build -t triton_trt_llm -f dockerfile/Dockerfile.trt_llm_backend .
I am intrested in building the tensorrtllm backend in debug mode so when launching Triton I can attach to the tensorrt_llm backend processes using gdb. In order to so I need to build tensorrt_llm backend from source in debug mode. I can not find any debug mode flags in the Dockerfile or the build scripts. Is there a way to build trtllm_backend in debug mode so when running gdb can attach to it?