Josef Adersberger
Josef Adersberger
- Support the Solr /export interface to transfer result sets from Solar to Spark (see https://cwiki.apache.org/confluence/display/solr/Exporting+Result+Sets). - Introduce DocValues for all relevant fields to be able to export them -...
- POJO representation - ChronixRDD - DataFrame
Integrate copied code from other sub-projects into these and get it out of Chronix Spark codebase
- Sub-chunking of a time series in fragments of a chronix chunk size - Linear regression on chunks - Mapping of regression values to symbolic representations
- join (chunks) - diff / delta - filter - lag - align - vectorization - statistics based on DoubleRDD incl. approx. - be inspired by - Spark-TS: TimeSeriesRDD -...
- Allow serialization in memory or on disk - Use Kryo as tried before or use another format like ByteArray or Apache Arrow. `conf.set("spark.serializer", "org.apache.spark.serializer.KryoSerializer"); conf.registerKryoClasses(new Class[]{ MetricTimeSeries.class, MetricObservation.class, MetricDimensions.class,...
One column per metric
Provide bidi transformations from/to ChronixRDD and Spark-TS' TimeseriesRDD