parquet4s icon indicating copy to clipboard operation
parquet4s copied to clipboard

Feat(core): make path filter configurable

Open i10416 opened this issue 1 year ago • 0 comments

This change adds a pathFilter option to ParquetReader builder interface because there are some situations where users needs to configure path filter predicates(e.g. They use _ prefix for partition columns).

Currently, there seems no option to change default path filter(org.apache.parquet.hadoop.util.HiddenFileFilter)

i10416 avatar Dec 27 '23 17:12 i10416