xitep

Results 28 issues of xitep

By default, the streaming flink executor periodically forwards ingestion time watermarks from the sources. in case _no windowing_ is part of a flow, this generates some unnecessary traffic; we can...

flink
performance

Executing a _stateful_ operator which itself does not define a windowing strategy and which consumes - directly or indirectly - a _non-windowed, unbounded_ data set is basically undefined. This is,...

enhancement

Map-side join is a special derivation of the `Join` operator, which can be turned into a plain `MapElements` operation, looking up the other side of the data to join in...

idea

It would be desirable to run a program consisting of multiple flows on different executors. Example: ```java PExecutor sparkExec = new SparkExecutor(mem, cores); PExecutor inmemExec = new InMemExecutor(mem, cores); Flow...

idea

Early triggering of merging windows is unsound! A merging window, e.g. session window, may change its identity over time. If such a window is fired multiple times while its identity...

bug
client-api

At some point in time we'll hit the point at which users will want to use an executor specific operation, which is not available through the euphoria API. We'd like...

client-api
idea

Euphoria's flink executor relies on the [environment.execute()](https://github.com/seznam/euphoria/blob/master/euphoria-flink/src/main/java/cz/seznam/euphoria/flink/FlinkExecutor.java#L140) to be a blocking call. However, if we submit a program in flink's detached mode on yarn, e.g. `flink -d ...`, the method...

bug
flink

Sometimes reading data is more expensive than processing it. In scenarios, where multiple programs process the same or nearly the same data, it is beneficial to execute them in parallel...

enhancement
performance
idea

Flink leverages during is optimization phase statistics returned by `InputFormat#getStatistics`. Currently, Euphoria's `DataSource` implementations have no way of providing such statistics to flink. Therefore: * Euphoria shall provide an additional,...

flink
performance

TrieMap.entrySet() will fails as it tries to use a `TreeSet` with incomparable elements. i fail to successfully build the project since i'm missing test data, but this would fix it:...