chronix.spark icon indicating copy to clipboard operation
chronix.spark copied to clipboard

Switch to other serialization format

Open adersberger opened this issue 8 years ago • 0 comments

  • Allow serialization in memory or on disk
  • Use Kryo as tried before or use another format like ByteArray or Apache Arrow.

conf.set("spark.serializer", "org.apache.spark.serializer.KryoSerializer"); conf.registerKryoClasses(new Class[]{ MetricTimeSeries.class, MetricObservation.class, MetricDimensions.class, MetricTimeSeriesKey.class, MetricTimeSeriesOrdering.class, FilterObservationByTimestamp.class, ChronixRDD.class, ChronixSparkContext.class, ChronixSolrCloudStorage.class});

adersberger avatar Apr 24 '16 19:04 adersberger