MLServer
MLServer copied to clipboard
Forward outputs when batching input requests together
trafficstars
When adaptive batching is enabled, the outputs field should be forwarded down to the merged request to ensure that the model receives all the info.