Read encrypted PARQUET files

Open jaimesalvador opened this issue 2 years ago • 3 comments

Is your feature request related to a problem or challenge?

I'm trying to use DATAFUSION to load some parquet-encrypted files, but I can't find the option to set the encryption parameters (key, etc).

I found ParquetReadOptions, but it seems don't have a encryption options.

Describe the solution you'd like

No response

Describe alternatives you've considered

No response

Additional context

No response

Mar 28 '23 14:03 jaimesalvador

https://github.com/apache/arrow-rs/issues/3511

Mar 28 '23 14:03 tustvold

I am interested and would like to give it a try.

Apr 08 '24 15:04 groupcache4321

FWIW there is a parquet reader that supports encryption in comet that might serve as some inspiration / source of code https://github.com/apache/datafusion-comet/tree/main/core/src/parquet

Apr 26 '24 19:04 alamb