Mridul M

I am trying to understand what is the actual usecase we are trying to target here. There is a behavior change here which has nontrivial implications - and I want...

My query was slightly different - are you actually seeing this issue ? Can you elaborate on what was observed ? There are corner cases which we do not deal...

I am not sure if this is some nuance of Standalone scheduler - will let @Ngone51 or @jiangxb1987 comment better. I have not observed such a behavior in yarn, or...

My main concern is whether we are working around an issue that should be investigated/fixed. Having said that, as I mentioned above, I dont see an issue as such with...

Merged to master. Thanks for fixing this @kevin85421 ! Thanks for the review @Ngone51 :-)

Doesn't this not break in local mode ?

@JoshRosen Ah yes, missed out on that - should have taken a more detailed look.

QQ @JoshRosen, @alex-balikov - if the expectation is that the variable can be recreated (if missing) at driver - with that being a remote possibility, do we want to make...

The proposed change looks good to me @JoshRosen

Btw, any thoughts on this ? > Are the changes here necessarily only for standalone ? Why not k8s and yarn ? The changes are specific to standalone - but...