Kaiwen Wang

Hey @dsuess thanks for the PR! Our team is also very interested in this feature. I'm wondering are you still working on it and is there an ETA?

Hi @dsuess, we usually need to retrieve the end of the log, mostly for debugging purposes. For ex. we have hard cutoffs in integration tests, and it would be nice...

Hi @selitvin, thanks for the detailed response! For my use case, each row will probably be 1,000 to 10,000 floats. Do you think Petastorm would make sense in that case?...

For defining the output schema, your example worked because the fields of the transformed dictionary is the same as before. In my case, if I want to "flatten" the dataclass,...

Thanks @selitvin! I tried using `make_batch_reader` instead, but slightly different from your script since I wanted the output sizes to all have given `batch_size`: [see here](https://gist.github.com/kaiwenw/5bec3f981b8820a9d1992d6377e27794). On my machine, JSON...