Apply Iceberg/Delta partition information for file skipping

Open alex-zaitsev opened this issue 1 year ago • 3 comments

Partitioning is a part of Iceberg and DeltaLake protocol specification. It is already available in catalog implementation (https://github.com/ClickHouse/ClickHouse/blob/master/src/Storages/ObjectStorage/DataLakes/PartitionColumns.h) but need to be used in query time.

Related https://github.com/ClickHouse/ClickHouse/issues/67426

Sep 27 '24 14:09 alex-zaitsev

+1 for fixing this, seems like a quick win. would help me out alot.

Oct 11 '24 09:10 hottehead

Is that a duplicate of https://github.com/ClickHouse/ClickHouse/issues/54977 ?

Mar 24 '25 16:03 Enmk

DeltaLake: https://github.com/ClickHouse/ClickHouse/pull/78486

Apr 23 '25 17:04 zvonand

Implemented by upstream, released in 25.3.3

Aug 04 '25 14:08 alex-zaitsev