truss-examples icon indicating copy to clipboard operation
truss-examples copied to clipboard

Published 20 hours ago • verified publisher icon basetenlabs

Add vllm async generator truss example

Open bolasim opened this issue 2 years ago • 0 comments

I've been sending this around quite a bit. Would be nice to just be able to link to it here.

bolasim avatar Sep 07 '23 20:09 bolasim