Junfan Zhang

Results 434 comments of Junfan Zhang

For spark, the blockID is used to filter unused ids by upstream mapID Could you help describe more about this design, how about drafting a proposal?

I like this PR that refactor the client config. Could you help fix the failed test cases

> In this PR, I think @lifeSo used cache Configuration in TezClientConf, it is more efficient, but additional memory is required. LGTM. It looks the memory will not consume much...

cc @zhengchenyu I'm not familiar with Tez code.

> cc @xianjingfeng @zuston Could we finish this issue together? Yes. I will > Regarding upload to S3: As long as you use the Apache HDFS S3A adapter you can...

Is this on the roadmap? @jerqi @xianjingfeng

I'm interested on this proposal, and will implement this in rust side. @jerqi

The PR title should obey the rule like that `[#128] improvement(tests): Add a integration test case for Spark with MiniYarnCluster` And If this is on progress, you can mark this...

> I've encountered this problem too. Any ideas to fix this? @zuston I don't reproduce this case, do you want to fix this? @rickyma