dspy icon indicating copy to clipboard operation
dspy copied to clipboard

Published 20 hours ago • verified publisher icon stanfordnlp

Triton Inference Server

Open Anindyadeep opened this issue 8 months ago • 1 comments

When it comes to fully production grade inference servers, TIS is very much optimized and open sourced. So an integration of this in dspy along with trt llm (#1094) would be some great additions.

Anindyadeep avatar Jun 02 '24 18:06 Anindyadeep