scotty-window-processor icon indicating copy to clipboard operation
scotty-window-processor copied to clipboard

This repository provides Scotty, a framework for efficient window aggregations for out-of-order Stream Processing.

Results 18 scotty-window-processor issues
Sort by recently updated
recently updated
newest added

Hi, I found this repo through your excellent papers (Scotty, Cutty). I am trying to build the Flink adaptor and use it with the latest Flink distribution (1.14+). However I...

Bumps [gson](https://github.com/google/gson) from 2.8.2 to 2.8.9. Release notes Sourced from gson's releases. Gson 2.8.9 Make OSGi bundle's dependency on sun.misc optional (#1993). Deprecate Gson.excluder() exposing internal Excluder class (#1986). Prevent...

dependencies

Scotty's StreamSlicer starts a new slice based on the window edge that is returned by the function assignNextWindowStart. https://github.com/TU-Berlin-DIMA/scotty-window-processor/blob/2a6b33941ac1733fb7b8db2cece04b2afc61d40f/core/src/main/java/de/tub/dima/scotty/core/windowType/SlidingWindow.java#L41-L43 This does not work for sliding windows whose slide value is...

For a sliding window with size = 10 and slide = 4, the StreamSlicer does not get out of the while loop when processing the first tuple. https://github.com/TU-Berlin-DIMA/scotty-window-processor/blob/2a6b33941ac1733fb7b8db2cece04b2afc61d40f/slicing/src/main/java/de/tub/dima/scotty/slicing/StreamSlicer.java#L65-L69 Reason: For...

Hey, "Lift" function is lazily evaluated by calling the getAggValues() function, as it can be seen here: https://github.com/TU-Berlin-DIMA/scotty-window-processor/blob/a18a7dc101f814b41a416aca9785a5848221667d/flink-connector/src/main/java/de/tub/dima/scotty/flinkconnector/demo/FlinkQuantileDemo.java#L28-L32 You may consider triggering the "Lift" function when a window ends, instead...

Hi, We're facing the following exception while trying to adopt Scotty on the latest Flink-1.14.2: ``` switched from RUNNING to FAILED with failure cause: java.lang.ArrayIndexOutOfBoundsException: -1 at java.util.ArrayList.elementData(ArrayList.java:424) at java.util.ArrayList.get(ArrayList.java:437)...

Implementation of Slide-by-tuple window and tests - Adaption in Window Context and Slice Manager to enable Out-of-order Processing

in progress

Implementation of Threshold Frame and Tests with: - Adaption in Window Context and Slice Manager to enable Out-of-order Processing

in progress

We should add a benchmark implementation for out-of-order streams.

We should make the maven package available by publishing it to Maven central.