flink-htm
flink-htm copied to clipboard
Implement event-time ordering
It is possible for events to arrive out-of-order into the HTM operator. We should reorder the events using an internal queue, using the watermark to make progress.
See the flink-cep library for an example of this: CEPPatternOperator.
HTM. Java sensors index every element. This was preparation for parallel decoding which hasn't been turned on; but is present. Maybe you should consider going through the sensor layer because it does a lot for you?
Though I was thinking, if the data is out of order before it reaches htm.java - then Sensor indexing won't help?
@cogmission reordering must be done at the Flink layer, using the event time information and watermarks.