Han Ju

Results 4 issues of Han Ju

A preview for an asynchronous local executor. It uses the module `concurrent.futures` which is back-ported to python2. It introduces an `AdaptorFuture` that covers the semantic gap between `simpleflow`'s Future and...

Per discussion with @ggreg , we notice that the semantic difference between our version of future (`simpleflow.futures.Future`) and python's future (`concurrent.futures.Future`) is mainly: 1. behavior when blocking (access to result...

在解释`sortByKey`的时候: https://github.com/JerryLead/SparkInternals/blob/master/markdown/2-JobLogicalPlan.md `sortByKey`实际使用的是`RangePartitioner`。分片排序之后,我们还需要分片之间的顺序关系才能最终输出排序后的结果。 代码: https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/rdd/OrderedRDDFunctions.scala#L62

I need to use this pull-request plugin in a job where 2 repos need to be checked-out: - one main project whose pull-request branch is the test target - one...

question