orc
orc copied to clipboard
ORC-1286: [C++] replace DataBuffer with BlockBuffer in class BufferedOutputStream
What changes were proposed in this pull request?
This PR can solve the huge memory taken by BufferedOutputStream and refactor the write data logic in class CompressionBase.
Why are the changes needed?
This patch use BlockBuffer to replace DataBuffer of class BufferedOutputStream in order to solve the issue.
How was this patch tested?
The UTs in TestBufferedOutputStream.cc and TestCompression.cc can cover this patch.
@coderex2522 . Could you use a new JIRA instead of using
PART 1
andPART II
? Apache community uses ORC JIRA ID for trace-ability.
@dongjoon-hyun Thank you for your suggestion. I create a new JIRA ORC-1286.
Thank you for updating the PR and creating JIRA, @coderex2522 .
Merged to main for Apache ORC 1.9.
cc @williamhyun , too