roryqi

Yarn node's decommission. https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/GracefulDecommission.html Maybe, we should also realize other system decommission implement.

cc @colinmjj . What do you think? I remember that you want to use coordinator to dispatch the configuration to shuffle servers. It's similar to use coordinator to decommission.

> @zuston The current implementation limit the number of connection, because don't want too many connection established between client and shuffle server. We also plan to improve this by using...

> So do we have a roadmap of version-release/features in github? @jerqi Not yet. 0.6 version's main feature is to support K8S.

There is an activity called Tencent's OpenSourceTalent (https://github.com/Tencent/OpenSourceTalent/issues/28). The first task is similar to the issue. There will be some students to finish the work.

> I'm neutral for `activeByDefault`, but recommend to unify the profile style, e.g. > > ``` > spark-2.3 > spark-2.4 > spark-3.0 > spark-3.1 > spark-3.2 > ``` It's good...

> > ... the default profile is the version which we mainly support. > > With the community growing, other versions of Spark may be adopted by users in large-scale...

Actually I think it brings extra complexity in order to avoid initializing a thread, it's a little worthless.

I'll close it, if you have another better solution, you can raise another pr.

Will the feature influence the performance?