Gang Wu comments

Results 304 comments of


                                            Gang Wu

Bump jackson.version from 2.16.0 to 2.16.1

@dependabot rebase

PARQUET-2449: Limit local buffer to be similar to Hadoop writing

@chadselph Could you confirm that it fixes the issue?

PARQUET-2449: Limit local buffer to be similar to Hadoop writing

Thanks for confirming! @chadselph Good job! @amousavigourabi

PARQUET-2416: Use 'mapreduce.outputcommitter.factory.class' in ParquetOutpuFormat

Could you please make CI happy?

PARQUET-2237 Improve performance when filters in RowGroupFilter can match exactly

cc @gszadovszky @ggershinsky @shangxinli

PARQUET-2237 Improve performance when filters in RowGroupFilter can match exactly

Unfortunately we cannot modify the signature of any public methods. My suggestion was to make the new enum serves as an internal state of the visitor (and probably use it...

PARQUET-2237 Improve performance when filters in RowGroupFilter can match exactly

cc @zhongyujiang Not sure if you are interested in reviewing this PR.

PARQUET-2237 Improve performance when filters in RowGroupFilter can match exactly

> Thanks @yabola for coming up with this idea. Let's continue the discussion about the BloomFilter building idea in the jira. > > Meanwhile, I've been thinking about the actual...

PARQUET-2415: Reuse hadoop file status and footer in ParquetRecordReader

Have you tried to run mvn install before running the cli test? It may run the test with dependency from maven central without your patch.

add support re-encryption in ColumnEncryptor

BTW, I am working on https://github.com/apache/parquet-mr/pull/1014 to unify several rewriters and most logic of `class ColumnEncryptor` will be relocated to `class ParquetRewriter`. Maybe we should cooperate to avoid bulk merge...