PARQUET-869 Configurable min/max record counts for block size check
Make min/max record counts for block size check are no longer hard coded inside InternalParquetRecordWriter.
Thanks for doing this, @pradeepg26! We've occasionally had use cases where it would have been nice. My two main concerns are the unnecessary boolean controlling whether or not to estimate when to do the next check and the naming. Naming should use "row group" instead of "block".
bump? note disclosure on https://eng.uber.com/petastorm/
@pwais, this was replaced by #470 that includes updates for problems in this PR. Unfortunately, other committers decided they did not want to change internal APIs so it was not committed.
Thank you!