parquet-java icon indicating copy to clipboard operation
parquet-java copied to clipboard

Support configurable for DirectByteBufferAllocator from Hadoop Configuration

Open asfimport opened this issue 5 years ago • 0 comments

Now in [HadoopReadOptions|([https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/src/main/java/org/apache/parquet/HadoopReadOptions.java#L85]] class, we cannot change default allocator from Hadoop Configuration.

 

Add a config parquet.allocator.direct.enabled to enable DirectByteBufferAllocator in ParuqetFileReader

Reporter: ShuMing Li

Related issues:

PRs and other links:

Note: This issue was originally created as PARQUET-1771. Please see the migration documentation for further details.

asfimport avatar Jan 16 '20 07:01 asfimport