Gang Wu

icon indicating an email [email protected]

icon company Singdata icon location Bellevue, WA icon location PMC Member of Apache {ORC, Parquet, Arrow}. Ex-{@uber, @alibaba}. Alumni of {USTC, CMU}.

Results 304 comments of Gang Wu

Bump pydantic to v2

PR of adding logical types has been merged. Please rebase this on top of the latest commit, thanks!

Bump pydantic to v2

Thanks! I will take a look after back from vacation.

Bump pydantic to v2

I just merged it. Thanks @zhangfengcdt for working on this and everyone for the review!

GH-3242: Emit and Read min/max statistics for int96 timestamp columns

@rahulketch Sorry I'm too busy these days. Perhaps I can find some time next week.

PARQUET-3031: Support to transfer input stream when building ParquetFileReader

It looks reasonable to me and users can choose their best fit. cc @gszadovszky @steveloughran

GH-41719: [C++][Parquet] Cannot read encrypted parquet datasets via _metadata file

Although I understand the intention of this issue and the corresponding fix, I don't think the design of parquet encryption has included the `_metadata` summary file because it may point...

GH-41719: [C++][Parquet] Cannot read encrypted parquet datasets via _metadata file

BTW, `_metadata` summary file is something that we strive to deprecate in the new parquet v3 design. If you have any concrete use case, please let us know to see...

GH-41719: [C++][Parquet] Cannot read encrypted parquet datasets via _metadata file

Yes, these files may have different master keys, which are unable to be referenced by a single footer IMHO.

GH-41719: [C++][Parquet] Cannot read encrypted parquet datasets via _metadata file

For the record: the community is inclined to deprecate `ColumnChunk.file_path`: https://lists.apache.org/thread/qprmj710yq92ybyt89m5xgtqyz3o3st2 and https://github.com/apache/parquet-format/pull/242/files#r1603234502 I'm not sure if we want to support and maintain this. cc @emkornfield @pitrou @mapleFU

Fix CMake modules for finding external libraries

Thanks for creating this PR! > The CMake modules are broken. Building anything that depends on orc using cmake (e.g. Apache Arrow) does not work. Could you elaborate this? I...