Wenchen Fan comments

Results 245 comments of


                                            Wenchen Fan

[MINOR][SQL] Simplify the description of built-in function.

Can you describe a bit more about the user-facing change? This adds `\n` in some cases and should affect `DESCRIBE FUNCTION`

[SPARK-39896][SQL] UnwrapCastInBinaryComparison should work when the literal of In/InSet downcast failed

looks much clearer now!

[SPARK-39896][SQL] UnwrapCastInBinaryComparison should work when the literal of In/InSet downcast failed

thanks, merging to master/3.3!

[SPARK-39833][SQL] Remove partition columns from data schema in the case of overlapping columns to fix Parquet DSv1 incorrect count issue

@sadikovi which spark version starts to have this bug?

[SPARK-38639][HIVE]Ignore the corrupted rows that failed to deserialize in hive sequence table

Does Hive have this feature?

[SPARK-39750][SQL] Enable `spark.sql.cbo.enabled` by default

cc @sigmod @maryannxue @viirya

shortestPathTo can't handle negative weighted edge

Or could we add a `shortestPathFrom` method for `Graph` using bellman-ford?

shortestPathTo can't handle negative weighted edge

This won't work, as it still results `a -> c` as shortest path in my example, which is wrong. An available approach is using johnson algorithm, but we still need...

[SPARK-38717][SQL] Handle Hive's bucket spec case preserving behaviour

thanks, merging to master!

[SPARK-38717][SQL] Handle Hive's bucket spec case preserving behaviour

@peter-toth can you open a backport PR for 3.3? There are conflicts. Thanks!