sagemaker-inference-toolkit icon indicating copy to clipboard operation
sagemaker-inference-toolkit copied to clipboard

Is streaming supported?

Open inf3rnus opened this issue 11 months ago • 0 comments

Hi,

This isn't documented anywhere, or at least where I've looked.

Looking at the MMS repo's issues, I don't think it is.

But a confirmation on this/an updating of the docs would be greatly appreciated.

Thanks, Aaron

inf3rnus avatar Mar 22 '24 01:03 inf3rnus