tensorrtllm_backend icon indicating copy to clipboard operation
tensorrtllm_backend copied to clipboard

Published 20 hours ago • verified publisher icon triton-inference-server

Warmup Example of loading LoRa weights

Open TheCodeWrangler opened this issue 10 months ago • 6 comments

Is warmup supported for the tensorrtllm_backend? If so it would be nice to have an example of how to upload LoRa adapters as a warmup step.

TheCodeWrangler avatar Apr 18 '24 16:04 TheCodeWrangler