Haejoon Lee

Not support rename DataFrame.columns assigning directly.

1

when rename columns of DataFrame, pandas are supporting below way, ```python >>> pdf = pd.DataFrame({ ... 'a': [1, 2, 3, 4, 5, 6, 7, 8, 9], ... 'b': [4, 5,...

Groupby with MultiIndex column for DataFrame raises ValueError

1

Related with #1030 there is some issue at groupby when MultiIndex column like: ```python >>> kdf = ks.DataFrame({'a': [1, 2, 3, 2], 'b': [4.0, 2.0, 3.0, 1.0]}) >>> kdf.columns =...

[SPARK-40512][PS][INFRA] Upgrade pandas to 1.5.0

3

### What changes were proposed in this pull request? This PR proposes to upgrade pandas version to 1.5.0 since the new pandas version is released. Please refer to [What's new...

[SPARK-46820][PYTHON] Fix error message regression by restoring `new_msg`

1

### What changes were proposed in this pull request? This PR proposes to fix error message regression by restoring `new_msg`. ### Why are the changes needed? In the past few...

[SPARK-46858][PYTHON][PS][BUILD] Upgrade Pandas to 2.2.0

1

### What changes were proposed in this pull request? This PR proposes to upgrade Pandas to 2.2.0. See [What's new in 2.2.0 (January 19, 2024)](https://pandas.pydata.org/docs/whatsnew/v2.2.0.html) ### Why are the changes...

### What changes were proposed in this pull request? This PR introduces the `pyspark.logging` module to facilitate structured client-side logging for PySpark users. This module includes a `PySparkLogger` class that...

### What changes were proposed in this pull request? This PR proposes to remove special casing for Protobuf functions in Connect This PR try resolving the follow tasks described from...

[SPARK-49768][SQL] Provide error conditions for `make_date`/`make_timestamp` errors `_LEGACY_ERROR_TEMP_2000`

4

### What changes were proposed in this pull request? This PR proposes to provide proper error conditions for `_LEGACY_ERROR_TEMP_2000` and improve the error message ### Why are the changes needed?...