orc icon indicating copy to clipboard operation
orc copied to clipboard

ORC-1264: [C++] Add a writer option to align compression block with row group

Open luffy-zh opened this issue 1 year ago • 0 comments

What changes were proposed in this pull request?

Add support for the ORC writer to ensure that the compression block is aligned with the row group boundary。

Why are the changes needed?

To reduce unnecessary I/O and decompression when PPD is in effect, we can enforce the compression block to be aligned with the row group boundary. For more detail, see link

How was this patch tested?

Uts in TestWriter.cc can convert this patch.

Was this patch authored or co-authored using generative AI tooling?

NO

luffy-zh avatar Aug 16 '24 09:08 luffy-zh