orc
orc copied to clipboard
apache
Apache ORC - the smallest, fastest columnar storage for Hadoop workloads
### What changes were proposed in this pull request? This PR proposes to replace the [`aircompressor`](https://github.com/airlift/aircompressor) library for ORC's ZStandard compression with [`zstd-jni`](https://github.com/luben/zstd-jni), which is a set of JNI bindings...
### What changes were proposed in this pull request? Simplify interactions with Map in TypeDescription class ### Why are the changes needed? Reduce code complexity ### How was this patch...
### What changes were proposed in this pull request? Fix confusing logging regarding ORC Reader and max-length-size. ### Why are the changes needed? Avoid operator confusion as it pertains to...
### What changes were proposed in this pull request? Remove the dependency on Hadoop's Text class from RedBlackTree. This has the added benefit of skipping the step where the incoming...
I would like to run `mvn -Dmaven.test.skip=true clean package`, but `maven-dependency-plugin` complains `Unused declared dependencies` for some libraries used by the test code, which breaks the compilation. Please check the...
Support the new fast Vectored Read API in ORC for parallel reads. The patch was tested internally along with S3
### What changes were proposed in this pull request? This PR can solve the huge memory taken by BufferedOutputStream and refactor the write data logic in class CompressionBase. ### Why...
### What changes were proposed in this pull request? This pr is aimed to refactor the support of selected vector. ### Why are the changes needed? reduce code duplication ###...
Hello, Using arrow adapter, I became aware that the memory (RAM) footprint of the export (exporting an orc file) was very huge for each field. For instance, exporting a table...
- [x] GitHub Action CI Check. - https://github.com/apache/orc/actions/workflows/build_and_test.yml?query=branch%3Abranch-1.9 - Java - 8.0.402+6 - 11.0.22+7 - 17.0.10+7 - C++ - GNU 8.3.0/9.3.1/9.4.0/10.2.1/11.4.0/11.4.1/12.2.0/12.3.1 - AppleClang 13.0.0.13000029/14.0.0.14000029/15.0.0.15000040 - MSVC 19.29.30153.0 - Ubuntu 20.04.6...
