Junfan Zhang comments

Results 434 comments of


                                            Junfan Zhang

Task executors that support specific roles are restarted when they fail

@oliverhu Please check it. Further more, maybe elastic training also need above feature.

WIP: [FLINK-XXXXX] Task local recovery for the reactive mode.

Interesting feature! Thanks for your great working. @dmvk Do we have a jira issue to track? Or any detailed description or FLIP. I’m interested on it about task recovery and...

[SUB-TASK][KPIP-2] Support YARN application-mode

Interested on it. Could u please assign this ticket to me? @yanghua

Write to hdfs when local disk can't be write

I think this PR is a good improvement! We also need this PR to avoid the problem of full local disk, although we dont hope to enable the big block...

Write to hdfs when local disk can't be write

Do you have time to invest this PR, I hope this can be introduced in our company internal version, looking forward to be merged assp. @xianjingfeng

Write to hdfs when local disk can't be write

Merged. @xianjingfeng Thanks for your contribution

Introduce data cleanup mechanism on stage level

PTAL @jerqi . The unregister is now scoped with Spark, MR will be supported in the next commits.

Introduce data cleanup mechanism on stage level

> > PTAL @jerqi . The unregister is now scoped with Spark, MR will be supported in the next commits. > > Why do the mr need to clean up...

Introduce data cleanup mechanism on stage level

Gentle ping @jerqi If u have time, could u help review this? I think I have some time to quick fix at national day.

Introduce data cleanup mechanism on stage level

> One question? Why do we add the concept of PurgeEvent? What's the advantage? Could we just add a shuffle level deletion method for StorageManager? Two reasons. 1. Make clearResourceThread...