Yuming Wang comments

Repositories
Issues
Comments

Results 33 comments of


                                            Yuming Wang

[SPARK-49968][SQL] The split function produces incorrect results with an empty regex and a limit

cc @vitaliili-db

[SPARK-49968][SQL] The split function produces incorrect results with an empty regex and a limit

@cloud-fan This is a behavior change since Spark 3.4. | SELECT str_to_map('p9999.c1.m9999.l5352', '\\.', '')['p']; | SELECT split('p9999', '', 2); -- | -- | -- Spark 3.4 | 9 | ["p","9"]

[SPARK-33538][SQL]Directly push IN predicates to the Hive Metastore

> Safer Strategy - only rewrite to IN (...): If there's more than one value. @Tagar `OptimizeIn` will rewrite `In` to `EqualTo` If there's only one value: https://github.com/apache/spark/blob/da67217590cda3d287eaf66f68eb2613273629b4/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala#L324-L329