parquet-java
parquet-java copied to clipboard
Sample of usage Parquet-1396 and Parquet-1178 for column level encryption with pluggable key access
This Jira provides a sample to use Parquet-1396 and Parquet-1178 column level encryption with pluggable key access. The Spark SQL application shows how to configure Parquet-1396 to encrypt and columns. The project CryptoMetadataRetriever shows how to implement the interface defined in Parquet-1396 as an example.
The project to be uploaded soon.
Reporter: Xinli Shang / @shangxinli
Related issues:
- EncryptionPropertiesFactory and DecryptionPropertiesFactory (Blocked)
- Passing Field Metadata to Parquet (Blocked)
- Parquet modular encryption (depends upon)
Externally tracked issue: https://github.com/apache/parquet-java/issues/2220
Note: This issue was originally created as PARQUET-1397. Please see the migration documentation for further details.
Gabor Szadovszky / @gszadovszky: As it is related to encryption which is not targeted to 1.11.0 I'm removing target from here.