Gaffer icon indicating copy to clipboard operation
Gaffer copied to clipboard

Add reduce option on accumulo-spark ImportRDDOfElements

Open james010101101 opened this issue 7 years ago • 2 comments

Currently the importRDDOfElements operations just partition's the elements according to the accumulo table's split points and writes the result to HDFS to be imported, We should add an option so that the RDD can be aggregated before partitioning.

james010101101 avatar Jun 19 '17 12:06 james010101101

@james010101101 is this still required? Have you done any work on it?

p013570 avatar Nov 23 '17 16:11 p013570

As noted above, this should be optional. The default option should be to perform the aggregation (as long as there are some groups with aggregation enabled).

gaffer01 avatar Oct 16 '19 08:10 gaffer01