parquet4s
parquet4s copied to clipboard
Feat(core): make path filter configurable
This change adds a pathFilter option to ParquetReader builder interface
because there are some situations where users needs to configure path filter
predicates(e.g. They use _
prefix for partition columns).
Currently, there seems no option to change default path filter(org.apache.parquet.hadoop.util.HiddenFileFilter
)