Yujiang Zhong comments

Results 51 comments of


                                            Yujiang Zhong

[Spark]: Adapting 'path' to Spark's 'location' in table props and supporting the customization of the table location when creating a table

cc @Zouxxyy @YannByron Can you help review this? Thanks!

[Spark]: Adapting 'path' to Spark's 'location' in table props and supporting the customization of the table location when creating a table

Hi @JingsongLi This is not introducing a new option, but rather better adapting to the Spark engine. Because Spark has always used it to represent [the location of the table](https://github.com/apache/spark/blob/08943104fad9f5ea274e022d75135aedc55a566f/sql/catalyst/src/main/java/org/apache/spark/sql/connector/catalog/TableCatalog.java#L51)....

[Spark]: Adapting 'path' to Spark's 'location' in table props and supporting the customization of the table location when creating a table

@Zouxxyy @JingsongLi Thanks for updating this, I'm sorry that I am not following up on this PR in time.

Parquet: Make row-group filters cooperate to filter

Hey @amogh-jahagirdar @Fokko @nastra @danielcweeks, can you help review this when you have time? Thanks

Parquet: Add page filter using page indexes

Thanks for your sharing! > The filter is applied at the row group level, but it looks like that's not how RowRanges works in Parquet, so this probably needs to...

Parquet: Add page filter using page indexes

> I'm all for adding what we need to Parquet. We can continue to use reflection until it is available. > > I think the main thing is that we...

Core, Spark: Fix delete with filter on nested columns

@aokolnychyi @rdblue can you help review this?

Core, Spark: Fix delete with filter on nested columns

@blakewhatley82 @mdub I think this fix is incorrect because the null count data of nested columns in metadata might be incorrect for now, see #8611. I am not able to...

Core, Spark: Fix delete with filter on nested columns

Fixed by #11261.

API: Binder should not simplify isNull and notNull when their reference …

Hey @aokolnychyi , do you have time to review this?