spark-recommender icon indicating copy to clipboard operation
spark-recommender copied to clipboard

Published 20 hours ago • verified publisher icon OndraFiedler

Avoid using groupByKey

Open deric opened this issue 10 years ago • 0 comments

Instead using .groupByKey() we should use .reduceByKey(_ + _), to avoid shuffling.

It is used e.g. here:

Reference: prefer_reduceby

deric avatar Feb 07 '15 14:02 deric