Return someting as soon as possible

[kosarko]

When the input is larger than the batch size (ie. we'll be creating multiple batches from the input) it should be possible to produce some output as the batches are processed, instead of waiting for the whole input to be processed.