parquet-java
parquet-java copied to clipboard
Support configurable for DirectByteBufferAllocator from Hadoop Configuration
Now in [HadoopReadOptions|([https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/src/main/java/org/apache/parquet/HadoopReadOptions.java#L85]] class, we cannot change default allocator from Hadoop Configuration.
Add a config parquet.allocator.direct.enabled to enable DirectByteBufferAllocator in ParuqetFileReader.
Reporter: ShuMing Li
Related issues:
- ColumnChunkPageWriter uses only heap memory. (relates to)
PRs and other links:
Note: This issue was originally created as PARQUET-1771. Please see the migration documentation for further details.