LocustDB icon indicating copy to clipboard operation
LocustDB copied to clipboard

Expand cases where intermediary results can be streamed between operators

Open cswinter opened this issue 6 years ago • 0 comments

There are a lot of cases where intermediary results could be streamed between operators, but aren't. One example is inability to stream from operators that produce a full output. There are probably some low hanging fruit, but proper solution is more involved and will need to revisit the overall design to solve this better, probably moving the graph partitioning from QueryExecutor to QueryPlanner to allow insertion of additional operators to aid streaming data.

cswinter avatar Dec 20 '18 03:12 cswinter