parquet-go
parquet-go copied to clipboard
parquet-tool - split command usability not ideal
Describe the bug
larger files are only split if both the --row-group-size
and --file-size
parameters are set, setting the latter alone won't result in files being split. I think if the file size < row group size the file size parameter should take precedence.
parquet-go specific details
- 0.9.0
Misc Details
- File is a previously compacted file of ~28MB with a row group size of 128MB