YangJie
YangJie
Should re-run `SPARK_GENERATE_GOLDEN_FILES=1 build/sbt "sql/testOnly *ExpressionsSchemaSuite"` to re-generate golden files
1.61.0 released, mark this one to draft first - https://github.com/grpc/grpc/releases/tag/v1.61.0
The version has been unified to the 1.62 series now
Thanks @dongjoon-hyun and @srowen
@panbingkun Let's re-enable the doctest, this test was pass in pyspark-sql task and failed in pyspark-connect task before https://github.com/apache/spark/blob/514ecc6fc183d7222b9dc299af4df328c71966d1/python/pyspark/sql/functions/builtin.py#L15053-L15058 and remove the TODO https://github.com/apache/spark/blob/514ecc6fc183d7222b9dc299af4df328c71966d1/python/pyspark/sql/functions/builtin.py#L15010-L15013 also cc @HyukjinKwon
I think the current issue is that the original PySpark can display complex struct types, ``` bin/pyspark Python 3.11.1 (v3.11.1:a7a450f84a, Dec 6 2022, 15:24:06) [Clang 13.0.0 (clang-1300.0.29.30)] on darwin Type...
> I think we should simply disallow this. We could have a legacy conf, but it doesn't much make sense. What does it return for `ArrayType` and `MapType`? Should we...
Is this considered a bug fix? Do we need to backport it to branch-3.5/3.4
I don't oppose this resolution, but if `to_csv` can handle complex data structures, what would our subsequent plans be? Would `from_csv` also need to support complex data structures to make...
Hello ~ Is there any progress on this PR?