iceberg-rust
iceberg-rust copied to clipboard
feat(datafusion): Support pushdown more datafusion exprs to Iceberg
fixes: #644
DataFusion expressions and Iceberg predicates do not have a one-to-one correspondence.
- Columns and literals are represented as
Exprin DataFusion, whereas they are merely components of predicates in Iceberg. AndandOrare operators in DataFusion, but they are treated as predicates in Iceberg.
This disparity complicates the transformation process when using TreeNode. To address this, I also refactored the code to simplify it.
@liurenjie1024 @Xuanwo @sdd @a-agmon please help to review when you are free, thanks
thanks @sdd @a-agmon @Xuanwo for the reviewing.