tensorrtllm_backend icon indicating copy to clipboard operation
tensorrtllm_backend copied to clipboard

Published 20 hours ago • verified publisher icon triton-inference-server

What is the purpose of shm-region-prefix-name and what is the prefix0_ files used for?

Open sugam-nexusflow opened this issue 9 months ago • 0 comments

Also, does the docker shared memory size impact the inference speed?

sugam-nexusflow avatar Jan 28 '25 21:01 sugam-nexusflow