tensorrtllm_backend icon indicating copy to clipboard operation
tensorrtllm_backend copied to clipboard

Published 20 hours ago • verified publisher icon triton-inference-server

Does TensorRT LLM Backend support multi-machine deployment now?

Open SeibertronSS opened this issue 1 year ago • 0 comments

Does TensorRT LLM Backend support multi-machine deployment now? Can give an example?

SeibertronSS avatar Jul 23 '24 00:07 SeibertronSS