MithunR comments

Results 156 comments of


                                            MithunR

Update fastparquet to 2024.5.0 for numpy2 compatibility [databricks]

> Please evaluate if it's still necessary to maintain the test run using fastparquet 0.8.3? At the time I wrote the fastparquet tests, the later fastparquet versions were still in...

Fix `orc_write_test.py` for [databricks] 14.3

Build

Fix `orc_write_test.py` for [databricks] 14.3

Sorting the test failure out now. Applying the patch on main seems to have messed up the imports, I think.

Fix `orc_write_test.py` for [databricks] 14.3

Build

Fix `orc_write_test.py` for [databricks] 14.3

Thank you for the review, @revans2. I've merged this change.

[FEA] Support spark.sql.readSideCharPadding for CHAR columns with Spark 3.4+

This is interesting. Here is the "failing" read plan: ``` GpuColumnarToRow false +- GpuProject [foo#24, gpuconcat(", foo#24, ") AS concat(", foo, ")#21, length(foo#24) AS length(foo)#22] +- GpuRowToColumnar targetsize(1073741824) +- *(1)...

[FEA] Support spark.sql.readSideCharPadding for CHAR columns with Spark 3.4+

I've set this to low priority. There is no data corruption, bad read, etc.

Skip AQE-join-DPP tests for [databricks] 14.3

Build

Skip AQE-join-DPP tests for [databricks] 14.3

Build

Skip AQE-join-DPP tests for [databricks] 14.3

Thank you for the review, @revans2. I've merged this change. I'll chase down #11643 ASAP.