C. H. Afzal

@gangahiremath - I think the two improvements aren't mutually exclusive - Given the testing done by @bnetzi and captured in [this document](https://docs.google.com/document/u/0/d/14x76jK7naRjxeFCkqUe7MgoDzZjYETixXXa828o0kSM/mobilebasic) - it seems that the one mutex per...

@yuchaoran2011 - Thanks for your response. So there are a couple of reasons: 1. We'll have to maintain functional parity of launching spark applications with spark-submit. Any changes/additions in spark-submit...

@yuchaoran2011 - We'll work on a design and share it with the community. Thanks.

Hey Guys - we have the [design doc ready](https://docs.google.com/document/d/1lICOCFWIpTEHbwKaz45EGG01hH-7gC8nQUWXC4qT1-I/edit?usp=sharing). Please feel free to add any comments/feedback. Also, added a PR link the doc that demonstrates what the changes would eventually...

@yuchaoran2011 Ah, I'd love to but given the doc. is on Salesforce account, the company policy restricts public access. Let me check within if there's a way for me to...

Happy New Year guys! :) - Wondering if you guys got a chance to go through the doc and have feedback to share? I have requested for the doc to...

@andreyvelich - Done. Kindly see if you can access now. My apologies but I was unable to make it universally accessible given Salesforce internal policies. I can't change the access...

@vara-bonthu Apologies for the delayed response. For us the hardware setup was 130 nodes in the cluster 16Gu memory each node and 4 CPUs A single instance of Spark Operator...

@yuchaoran2011 @vara-bonthu - I was wondering if we have your blessings and buy-in for the proposed design? If yes, we can raise PRs for the feature. Also on our end...

@bnetzi - so we changed the controller-thread config to a higher number. But given we had only 4 CPUs, increasing the number of threads beyond 4 wouldn't help (the CPUs...