text-generation-inference icon indicating copy to clipboard operation
text-generation-inference copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Expose the real-time internal state of the batcher through SSE

Open mfuntowicz opened this issue 8 months ago • 0 comments

mfuntowicz avatar Feb 27 '25 16:02 mfuntowicz