asfimport

Now in [HadoopReadOptions\|([https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/src/main/java/org/apache/parquet/HadoopReadOptions.java#L85]] class, we cannot change default allocator from Hadoop Configuration.   Add a config `parquet.allocator.direct.enabled` to enable `DirectByteBufferAllocator` in `ParuqetFileReader`.  **Reporter**: [ShuMing Li](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=lishuming) #### Related issues: - [ColumnChunkPageWriter uses...

InternalParquetRecordReader Logging is Too Verbose

4

A low-level library like Parquet should be pretty quiet. It should just do its work and keep quiet. Most issues should be addressed by throwing Exceptions, and the occasional warning...

[C++] Stream API: Add support for repeated fields

4

The parquet::StreamReader and parquet::StreamWriter classes currently only support required fields. Support must be added to this API in order for it to be usable when the schema has repeated fields.  ...

Avro's isElementType() change breaks the reading of some parquet(1.8.1) files

13

When using the Avro schema below to write a parquet(1.8.1) file and then read back by using parquet 1.10.1 without passing any schema, the reading throws an exception "XXX is...

This is an umbrella issue for the 2.7.0 release. Please add any issues you'd like to get into that release as blockers. **Reporter**: [Fokko Driesprong](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=fokko) / @Fokko **Assignee**: [Fokko Driesprong](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=fokko)...

[C++] Unable to read parquetjs-created file using low-level parquet-cpp API

2

Follow-up to PARQUET-1482: basic support for reading Parquet files with Data page V2 pages was added as a part of PARQUET-1482.   However, this was only added to the higher-level Arrow...

[C++] Data set integrity tool

2

Parquet encryption protects integrity of individual files. However, data sets (such as tables) are often written as a collection of files, say "/path/to/dataset"/part0.parquet.encrypted .. "/path/to/dataset"/partN.parquet.encrypted   In an untrusted storage, removal...

Improve logic when to write column indexes

2

Currently, we always write column indexes. In case of the data is ordered (ASCENDING or DESCENDING) the filtering would highly benefit from column indexes. While, if the data is UNORDERED...

I am trying to read a parquet file in scala using the Avro interface (1.10.). The file was also generated using the same interface. The data that I am writing...

Sample of usage Parquet-1396 and Parquet-1178 for column level encryption with pluggable key access

1

This Jira provides a sample to use Parquet-1396 and Parquet-1178 column level encryption with pluggable key access. The Spark SQL application shows how to configure Parquet-1396 to encrypt and columns....