Wenchen Fan comments

Results 245 comments of


                                            Wenchen Fan

[SPARK-49982][SQL] Fix negative caching in InMemoryRelation

thanks, merging to master!

[SPARK-52417][SQL] Simplify Table properties handling in View Schema Evolution Mode

Shall we also skip generating the view query output table properties when creating the view? @szehon-ho

[SPARK-49968][SQL] The split function produces incorrect results with an empty regex and a limit

Yea I think we should fix this, but given the behavior change is already shipped, we need a legacy config to protect this fix.

[SPARK-49968][SQL] The split function produces incorrect results with an empty regex and a limit

thanks, merging to master!

[SQL][Minor] Disable Recursive CTE self-references from window functions

the doc gen failure is unrelated, thanks, merging to master!

[SPARK-52482][SQL][CORE] ZStandard support for file data source reader

> The inlining of Hadoop's LineRecordReader would be needed regardless of ZSTD support because of a follow-up change that I am working on, which would add allow users to specify...

[SPARK-52482][SQL][CORE] ZStandard support for file data source reader

thanks, merging to master!

[SPARK-51831][SQL] Column pruning with existsJoin for Datasource V2

This approach is too hacky: it caches the scan builder with a tree node tag. Do you know which rule creates more column pruning oppturnities? We should probably delay the...

[SPARK-51831][SQL] Column pruning with existsJoin for Datasource V2

thanks, merging to master!

[SPARK-52388][SQL] Handle named and positional parameters under `PlanWithUnresolvedIdentifier`

My opinion is that `PlanWithUnresolvedIdentifier` should hide as few things as possible. We should change `PlanWithUnresolvedIdentifier(... => InsertIntoStatement)` to `InsertIntoStatement(PlanWithUnresolvedIdentifier(... => UnresolvedRelation))`