Hyukjin Kwon

icon indicating a website link https://www.linkedin.com/in/hyukjin-kwon-25045412b icon indicating an email [email protected]

icon company @Apache @Databricks icon location South Korea icon location Comments from this profile are opinions of the profile owner. ASF member, Apache Spark PMC member and committer @apache Staff Software Engineer @databricks

Results 207 comments of Hyukjin Kwon

[SPARK-39925][SQL] Add array_sort(column, comparator) overload to DataFrame operations

cc @zero323, @itholic, @zhengruifeng FYI (since we need to add PySpark and SparkR ones)

[SPARK-39925][SQL] Add array_sort(column, comparator) overload to DataFrame operations

Merged to master.

[SPARK-39938][PYTHON][PS] Accept all inputs of prefix/suffix which implement __str__ in add_predix/add_suffix

cc @xinrong-meng @itholic @zhengruifeng FYI

[SPARK-39824][PYTHON][PS] Introduce index where and putmask func in pyspark

cc @zhengruifeng @xinrong-meng @itholic FYI

[SPARK-40030][BUILD] Upgrade scala-maven-plugin to 4.7.1

Merged to master.

[POC][PYTHON][SS] Arbitrary stateful processing in Structured Streaming with Python

cc @viirya and @ueshin FYI who I think are the best ones who can review. I will attach some design docs, etc soon around next week likely.

[SPARK-40009][PYTHON][DOCS] Add doc string to DataFrame union and unionAll

Yeah can we fix the whole file instead of one API alone?

[SPARK-40009][PYTHON][DOCS] Add doc string to DataFrame union and unionAll

BTW thanks for working on this @khalidmammadov

[SPARK-38474][CORE] Use error class in org.apache.spark.security

yeah that test shouldn't be related, and it's just flaky.

[SPARK-38474][CORE] Use error class in org.apache.spark.security

LGTM2 otherwise. @sandeep-katta you might need to rebase your branch and sync to the latest master branch to avoid the linter job failure.