Duke icon indicating copy to clipboard operation
Duke copied to clipboard

Comparators and Cleaners Request to make Serializable

Open mam0nth opened this issue 10 years ago • 2 comments

Requesting to make the Comparators and Cleaners Serializable

mam0nth avatar Oct 09 '15 05:10 mam0nth

I assume this means with their configuration and all? Is there any specific use case you have in mind? I'm not against it, just curious.

Could you make a pull request for it?

larsga avatar Oct 10 '15 16:10 larsga

In my previous project we try to use it in Apache Spark and we use scala. Since the comparator and cleaner are not Serializable, we need to instantiate this in the functional block to be executed in yarn. We just want to initialize it first as one copy to be global, and it can also be used as broadcast variable in spark. Broadcast variable need to be a serializable. I will provide a pull request on my free time :)

mam0nth avatar Nov 27 '15 11:11 mam0nth