iceberg
iceberg copied to clipboard
Parquet: Set parquet bloom filter config with compatible column name
This PR improves the config setting for the parquet bloom filter.
- Log warn for those don't exist column or the column type is unsupported (boolean or complex data type).
- Convert the column name to a compatible one. This is because we make the column name compatible if it contains special character when we write the parquet file.
Hi, @huaxingao @rdblue @kbendick . Could you help to review this when you are free? Thanks a lot.
Thanks @rdblue @kbendick @zhongyujiang @huaxingao for your time to review. Comments have been addressed. Pls take another look when you are free.
@huaxingao can you take another look and push forward ? thanks
LGTM
cc @rdblue Could you please take another look when you have a moment?