MLServer icon indicating copy to clipboard operation
MLServer copied to clipboard

Show warning if batching shapes do not match

Open adriangonz opened this issue 2 years ago • 0 comments

When adaptive batching is enabled, the runtime may return a response with a different batch to the input one.

This results on some individual responses being empty when they go back.

adriangonz avatar Dec 15 '22 18:12 adriangonz