apache-spark-internals icon indicating copy to clipboard operation
apache-spark-internals copied to clipboard

Published 20 hours ago • verified publisher icon japila-books

rdd.filter() does not preserve partitioning?

Open rtkaleta opened this issue 8 years ago • 0 comments

Hi, thanks for writing the notebooks.

In the introduction to RDD partitioning you mention that the filter operation does not preserve partitioning. But I'm looking at the source code where I see that MapPartitionsRDD is instantiated with preservesPartitioning = true.

Doesn't this conflict your statement?

rtkaleta avatar Sep 26 '17 17:09 rtkaleta