TransmogrifAI icon indicating copy to clipboard operation
TransmogrifAI copied to clipboard

Investigate which classes require registration with Kryo

Open tovbinm opened this issue 7 years ago • 0 comments

Problem We might have some unregistered classes with Kryo that compromise performance.

Solution Investigate which classes require registration with Kryo by set spark.kryo.registrationRequired=true in TestSparkContext. Then go over failing tests and see if any classes need to be registered in OpKryoRegistrator.

Additional context Only do this once we upgrade to Spark 2.3 - #44

tovbinm avatar Oct 12 '18 20:10 tovbinm