MLServer icon indicating copy to clipboard operation
MLServer copied to clipboard

Forward outputs when batching input requests together

Open adriangonz opened this issue 4 years ago • 0 comments
trafficstars

When adaptive batching is enabled, the outputs field should be forwarded down to the merged request to ensure that the model receives all the info.

adriangonz avatar Sep 16 '21 11:09 adriangonz