truss-examples icon indicating copy to clipboard operation
truss-examples copied to clipboard
verified publisher icon basetenlabs

TRT-LLM builder example

Open aspctu opened this issue 1 year ago • 0 comments

This PR adds a high-performance TRT-LLM builder and serving truss.

aspctu avatar Mar 07 '24 14:03 aspctu