feathub
feathub copied to clipboard
Support interval join
Users should also be able to specify whether a build-side entry can be deleted after it is successfully matched with a probe-side event.
As an example user side, let's say we have video-click stream and video-view stream from Kafka. Both streams have trace_id as the primary key. And we want to join video-view stream (as probe-side) with video-click stream (as build-side) using trace_id as the join key. We want to discard those video-view entries if it is not successfully joined after a given time period. And we also want to discard those video-view entries after it is successfully joined.