Xi Chen

icon location Cheer!

Results 10 comments of Xi Chen

build(deps): bump pandas from 1.5.2 to 2.0.3

@dependabot rebase

[BUG] launcher issue using jupyterlab 3.6.3 / sparkmagic 0.21.0

We've encountered similar issue with jupyterlab 4.2.0 / sparkmagic 0.21.0

[SPARK-47952][CORE][CONNECT] Support retrieving the real SparkConnectService GRPC address and port programmatically when running on Yarn

Hi @TakawaAkirayo , thanks for working on this! I'm curious how you managed to submit SparkConnectService in Yarn cluster mode? It's not supported in [SparkSubmit](https://github.com/apache/spark/blob/168230a812870b51d84e0a2bd3d10cbba4994eaf/core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala#L310) AFAIK.

[SPARK-47952][CORE][CONNECT] Support retrieving the real SparkConnectService GRPC address and port programmatically when running on Yarn

@TakawaAkirayo That's good to know. Thanks for sharing! Side question, how do you manage the termination of Spark Connect servers? Users of JupyterHub usually restart or stop a kernel, would...

[SPARK-48669][K8S] K8s resource name prefix follows `DNS Subdomain Names` rule

Kindly ping @dongjoon-hyun as this is a continuation of [SPARK-39614](https://issues.apache.org/jira/browse/SPARK-39614)

[SPARK-48669][K8S] K8s resource name prefix follows `DNS Subdomain Names` rule

cc @pan3793 @yaooqinn @LuciferYang Please take a look, thanks!

[SPARK-46895][CORE][3.5] Replace Timer with single thread scheduled executor

Kindly ping @beliefer @LuciferYang @dongjoon-hyun.

[SPARK-46895][CORE][3.5] Replace Timer with single thread scheduled executor

> This is only a minor improvement for Spark 4.0, not a bug fix, and it should not be backported to 3.x. @LuciferYang Thanks for reply! It actually includes a...

[SPARK-46895][CORE][3.5] Replace Timer with single thread scheduled executor

> @jshmchenxi, Can we submit separate pull requests along with their primitive forms? Yes, I created another PR for the first commit: #47957. The second commit is in this PR....

[LIVY-702]: Submit Spark apps to Kubernetes

@askhatri Thanks for pushing this feature forward! As a side note, could you please add the original author, @jahstreet, to the author list? We've been using this feature for a...