datafusion icon indicating copy to clipboard operation
datafusion copied to clipboard

[WIP] fix: respect inexact flags in row group metadata

Open CookiePieWw opened this issue 6 months ago • 0 comments

Which issue does this PR close?

  • Closes #15976.

Rationale for this change

As title, wrap the max and min stats with Inexact or Exact respecting the flags in row group metadata.

What changes are included in this PR?

Since the corresponding change in arrow-rs has not been released, the dependencies also changed. Let's wait for arrow-rs's release :)

Are these changes tested?

This is an example fix with tests originally introduced in #15977. I constructed a parquet file with more columns and truncated stats and will add it later.

I wonder if we need to add the parquet into parquet-testing repo and add some unit tests.

Are there any user-facing changes?

CookiePieWw avatar Jun 14 '25 17:06 CookiePieWw