Mridul M

icon company LinkedIn icon location Santa Clara, CA icon location PMC Apache Spark, Apache Celeborn

Results 143 comments of Mridul M

[wip][SPARK-40320][Core] Executor should exit when it failed to initialize for fatal error

Added a few debug statements, and it became clear what the issue is. Essentially, since we are leveraging a `ThreadPoolExecutor`, it does not result in killing the thread with the...

[wip][SPARK-40320][Core] Executor should exit when it failed to initialize for fatal error

Thanks for the query @Ngone51 - I missed out one aspect of my analysis, which ends up completely changing the solution - my bad :-( The answer to your query...

[wip][SPARK-40320][Core] Executor should exit when it failed to initialize for fatal error

Can you take a look at comment above @yabola and work on the fix ? Since you already spent a lot of time on this.

[wip][SPARK-40320][Core] Executor should exit when it failed to initialize for fatal error

Can we also add the example code you had to reproduce the issue as a test ?

[wip][SPARK-40320][Core] Executor should exit when it failed to initialize for fatal error

+CC @Ngone51 I will merge it later tomorrow if no further comments.

[wip][SPARK-40320][Core] Executor should exit when it failed to initialize for fatal error

Looks like this dropped off my radar - merging to master.

[wip][SPARK-40320][Core] Executor should exit when it failed to initialize for fatal error

Thanks for working on this @yabola ! Thanks for the reviews and brainstorming on this @Ngone51 :-)

[wip][SPARK-40320][Core] Executor should exit when it failed to initialize for fatal error

I am assuming your jira id is `miracle` based on previous PR conversation - do let me know if that is incorrect @yabola !

[SPARK-39399] [CORE] [K8S]: Fix proxy-user authentication for Spark on k8s in cluster deploy mode

+CC @squito, @HyukjinKwon

[SPARK-40096]Fix finalize shuffle stage slow due to connection creation slow

+CC @otterc, @Ngone51 PTAL