harryjing
harryjing
> [@harryjing](https://github.com/harryjing) That fix didn't finally merge. Have you tried setting NVTX_DISABLE to 1? Is the NVTX_DISABLE flag only effective before building wheel package? If I directly modify the Python...
> Set the environment variable NVTX_DISABLE to 1 before running the trtllm-serve instance. I set the environment variable NVTX_DISABLE to 1, but the memory seems to be increasing; it went...
> In our online environment, we use versions 1.1.0 rc5 and 1.2.0 rc0. By setting NVTX_DISABLE=1 to disable the profiling feature in NVTX, we no longer observe significant memory leaks....